-- Logs begin at Thu 2022-09-01 04:36:23 UTC, end at Thu 2022-09-01 05:55:09 UTC. -- Sep 01 05:20:42.260171 dv-cinder-836027-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 05:20:42.269572 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 05:20:42 2022] *** Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: nodename: dv-cinder-836027-8-iscsi Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: machine: x86_64 Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: clock source: unix Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: pcre jit disabled Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: detected number of CPU cores: 4 Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: current working directory: / Sep 01 05:20:42.271548 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: detected binary path: /usr/bin/uwsgi-core Sep 01 05:20:42.272265 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: your processes number limit is 47680 Sep 01 05:20:42.272265 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: your memory page size is 4096 bytes Sep 01 05:20:42.272265 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: detected max file descriptor number: 2048 Sep 01 05:20:42.272265 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: lock engine: pthread robust mutexes Sep 01 05:20:42.272265 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: thunder lock: enabled Sep 01 05:20:42.272265 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 05:20:42.272265 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 05:20:42.309652 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: Python main interpreter initialized at 0x55df33d709c0 Sep 01 05:20:42.309652 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: python threads support enabled Sep 01 05:20:42.309652 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: your server socket listen backlog is limited to 100 connections Sep 01 05:20:42.309652 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: your mercy for graceful operations on workers is 90 seconds Sep 01 05:20:42.309981 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 05:20:42.310058 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: *** Operational MODE: preforking *** Sep 01 05:20:42.310291 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: *** uWSGI is running in multiple interpreter mode *** Sep 01 05:20:42.310291 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: spawned uWSGI master process (pid: 105831) Sep 01 05:20:42.310481 dv-cinder-836027-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 05:20:42.312120 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: spawned uWSGI worker 1 (pid: 105832, cores: 1) Sep 01 05:20:42.312120 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: spawned uWSGI worker 2 (pid: 105833, cores: 1) Sep 01 05:20:42.312120 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 05:20:42.965422 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:20:42.973485 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:20:44.033996 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:20:44.033996 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: from cryptography.utils import int_from_bytes Sep 01 05:20:44.034623 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:20:44.034623 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: from cryptography.utils import int_from_bytes Sep 01 05:20:44.042503 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:20:44.042503 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: from cryptography.utils import int_from_bytes Sep 01 05:20:44.042939 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:20:44.042939 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: from cryptography.utils import int_from_bytes Sep 01 05:20:46.542153 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:20:46.542862 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:20:46.542975 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:20:46.543335 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:20:46.543430 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:20:46.543508 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:20:46.543508 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:20:46.543645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:20:46.543893 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.544002 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:20:46.544216 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.544317 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:20:46.544534 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.544639 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.544852 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.544955 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.545179 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.545269 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.545487 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.545597 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.545805 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.545902 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.546116 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.546204 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.546955 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.547066 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.547223 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.547322 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.547538 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.547635 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.547835 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.547932 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-8-iscsi {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.548148 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.548246 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.548455 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.548551 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-8-iscsi {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.548765 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.548933 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.549068 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.549192 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.549358 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.549498 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.549673 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.549811 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.549979 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.550111 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.550295 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.550482 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.550613 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.550907 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.551115 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.551232 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.551422 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.551516 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.551724 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.551845 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.552061 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.552293 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.552474 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.552673 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.552868 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.553057 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.553217 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.553442 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.553593 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.553780 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.554001 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.554208 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.554398 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.554581 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-8-iscsi {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.554798 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.554986 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.555182 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-8-iscsi {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.555361 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.555522 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.555701 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.555886 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.556109 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.556300 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.556503 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.556776 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.556907 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.557061 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.557187 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.557319 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.557476 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.557617 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.557744 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.557874 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.558000 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.558152 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.558280 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.558438 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.558578 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.558706 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.558837 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.558962 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.559092 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.559230 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.559362 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.559522 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.559656 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.559782 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.559916 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.560042 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.560166 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.560296 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.560514 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.560644 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.560779 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.560912 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.561037 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.561178 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.561313 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.561446 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.561583 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.561709 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.561833 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.561970 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.562795 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.562945 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.563084 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.563218 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.563345 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.563470 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.563613 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.563740 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.563873 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.564008 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.564141 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.564279 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.564414 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.564540 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.564665 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.564796 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.564927 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.565060 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.565195 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.565321 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.565455 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.565582 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.565735 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.565879 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.566006 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.566137 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.566268 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.566394 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.566535 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.566673 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.566811 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.566937 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.567076 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.567206 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.567331 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.567469 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.567595 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.567719 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.567844 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.567976 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.568101 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.568248 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.568383 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.568515 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.568654 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.568786 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.568921 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.569060 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.569212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.569350 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.569518 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.569648 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.569823 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.569955 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.570129 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.570260 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.570466 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.570679 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.570827 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.570961 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.571094 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.571219 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.571344 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.571468 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.571606 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.571739 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.571903 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.572041 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.572203 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.572330 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.572510 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.572645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.572808 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.572937 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.573108 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.573247 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.573405 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.573546 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.573699 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.573837 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.574000 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.574141 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.574299 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.574449 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.574624 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.574766 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.574924 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.575065 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.575225 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.575353 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.575522 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.575658 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.575821 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.575958 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.576125 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.576254 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.576425 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.576562 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.576738 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.576882 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.577038 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.577166 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.577341 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.577475 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.577640 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.577770 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.577963 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.578092 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.578265 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.578396 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.578624 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.578799 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.578939 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.579065 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.579215 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.579347 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.579533 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.579674 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.579833 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.579972 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.580133 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.580269 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.580437 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.580567 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.580741 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.580860 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.581044 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.581147 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.581338 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.581437 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.581640 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.581738 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.581940 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.582047 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.582248 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.582384 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.582572 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.582701 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.582874 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.583004 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.583171 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.583301 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.583470 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.583601 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.583768 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.583905 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.584050 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.584183 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.584354 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.584484 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.584650 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.584788 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.584947 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.585084 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.585258 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.585389 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.585566 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.585705 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.585875 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.586015 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.586177 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.586306 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.586487 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.586629 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.586808 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:20:46.586938 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.587138 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.587268 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.587467 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.587605 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.587777 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.587905 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.588105 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.588241 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.588431 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.588567 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.588749 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.588879 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.589061 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.589198 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.589369 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.589498 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.589679 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.589812 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.589985 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.590128 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.590295 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.590447 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.590627 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.590757 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.590959 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.591100 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.591235 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.591368 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.591538 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.591678 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.591864 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.591995 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.592177 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.592307 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.592490 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.592627 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.592797 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.592937 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.593105 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.593241 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.593446 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.593578 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.593761 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.593899 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.594070 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.594200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.594378 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.594538 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.594740 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.594885 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.595056 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.595185 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.595376 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.595507 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.595695 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.595836 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.596005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.596137 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.596314 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.596467 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.596607 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.596785 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.596928 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.597096 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.597247 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.597417 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.597556 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.597751 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.597881 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.598062 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.598193 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.598380 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.598551 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.598716 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.598848 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.599039 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.599170 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.599351 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.599485 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.599662 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.599793 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.599972 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.600101 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.600279 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.600410 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.600587 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.600726 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.600913 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.601119 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.601258 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.601384 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.601509 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.601633 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.601830 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.601970 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.602140 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.602269 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.602467 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.602594 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.602778 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.602925 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.603083 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.603214 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.603383 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.603515 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.603684 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.603813 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.603987 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.604119 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.604285 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.604414 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.604575 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.604780 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.604908 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.605048 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.605174 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.605299 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.605491 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.605632 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.605801 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.605931 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.606107 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.606235 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.606429 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.606576 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.606739 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.606867 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.607039 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.607166 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.607345 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.607482 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.607647 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.607778 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.607946 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.608074 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.608253 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.608389 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.608556 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.608694 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.608854 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.609482 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.609705 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.609837 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.610006 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.610135 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.610308 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.610473 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.610625 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.610753 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.610936 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.611064 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.611267 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.611394 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.611533 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.611664 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.611832 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.611963 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.612140 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.612278 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.612449 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.612585 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.613011 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.613145 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.613328 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.613465 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.613638 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.613776 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.613952 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.614080 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.614273 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.614460 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.614590 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.614714 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.614908 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.615040 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.615206 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.615343 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.615511 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.615651 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.615812 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.615951 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.616113 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.616251 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.616411 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.616548 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.616710 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.616837 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.617006 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.617144 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.617307 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.617437 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.617604 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.617732 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.617902 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.618031 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.618200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.618328 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.618523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.618655 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.618827 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.618968 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.619127 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.619257 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.619428 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.619572 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.619728 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.619865 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.620030 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.620167 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.620331 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.620471 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.620672 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.620803 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.620978 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.621110 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.621306 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.621440 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.621626 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.621729 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.621934 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.622045 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.622252 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.622361 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.622584 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.622701 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.622893 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.622991 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.623214 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.623313 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.623506 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.623604 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.623813 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.623919 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.624118 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.624229 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.624432 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.624537 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.625300 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.625398 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.625624 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.625721 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.625931 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.626027 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.626250 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.626347 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.626579 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.626679 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.626895 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.627001 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.627197 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.627293 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.627513 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.627613 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.627849 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.627946 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.628168 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.628280 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.628477 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.628576 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629102 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629187 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629275 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629359 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629436 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629778 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629871 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.629979 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.630080 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.630286 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.630380 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.630617 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.630698 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.630933 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.631020 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.631239 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.631317 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.631554 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.631631 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.631858 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.631937 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.632177 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.632253 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.632477 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.632553 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.632790 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.632869 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.633090 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.633166 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.633508 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.633601 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.633770 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.633842 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.634028 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.634194 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.634331 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.634569 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.634690 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.634812 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.634961 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.635080 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.635266 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.635394 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.635567 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.635684 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.635871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.636004 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.636176 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.636294 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.636485 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.636604 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.636792 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.636908 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.637158 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.637280 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.637398 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.637513 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.637702 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.637819 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.638002 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.638119 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.638301 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.638450 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.638628 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.638745 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.638929 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.639046 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.639232 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.639357 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.639540 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.639681 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.639905 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.640054 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.640183 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.640309 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.640480 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.640619 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.640783 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.640914 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.641102 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.641233 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.641404 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.641545 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.641703 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.641832 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.642006 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.642137 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.642306 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.642470 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.642641 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.642773 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.642943 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.643067 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.643252 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.643426 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.643556 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.643682 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.643889 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.644104 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.644243 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.644370 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.644496 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.644621 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.644747 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.644872 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.645046 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.645178 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.645376 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.645511 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.645675 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.645813 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.645980 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.646113 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.646286 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.646442 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.646618 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.646763 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.646923 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.647054 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.647230 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.647360 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.647547 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.647687 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.647852 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.647983 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.648157 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.648287 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.648459 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.648598 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.648756 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.648885 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.649060 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.649196 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.649360 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.649503 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.649665 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.649931 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.650137 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.650266 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.650557 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.650708 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.650889 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.651027 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.651204 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.651333 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.651522 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.651655 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.651841 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.651987 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.652177 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.652314 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.652487 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.652628 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.652790 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.652931 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.653097 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.653229 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.653399 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.653562 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.653700 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.653830 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.654034 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.654247 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.654376 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.654554 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.654692 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.654820 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.654946 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.655070 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.655203 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.655328 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.655463 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.655596 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.655753 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.655886 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.656078 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.656208 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.656381 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.656512 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.656679 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.656808 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.656980 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.657119 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.657289 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.657428 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.657588 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.657724 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.657897 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.658104 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.658233 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.658358 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.658501 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.658639 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.658796 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.658936 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.659097 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.659228 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.659402 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.659531 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.659704 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.659845 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.660042 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.660264 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.660394 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.660520 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.660664 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.660791 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.660977 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.661109 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.661277 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.661407 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.661598 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.661737 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.661899 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.662028 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.662204 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.662334 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.662517 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.662656 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.662821 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.662953 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.663121 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.663251 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.663418 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.663541 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.663710 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.663835 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.664085 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.664251 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.664442 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.664569 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.664704 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.664837 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.664971 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.665107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.665233 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.665360 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.665485 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.665610 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.665764 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.665903 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.666063 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.666192 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.666360 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.666522 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.666683 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.666828 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.666987 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.667116 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.667287 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.667418 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.667581 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.667711 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.667887 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.668024 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.668184 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.668313 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.668489 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.668626 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.668787 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.668916 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.669087 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.669225 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.669387 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.669520 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.669687 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.669815 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.669988 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.670119 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.670274 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.670428 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.670613 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.670755 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.670916 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.671056 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.671213 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.671342 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.672026 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.672164 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.672333 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.672472 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.672635 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.672766 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.672931 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.673068 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.673231 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.673415 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.673545 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.673712 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.673841 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.673966 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.674199 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.674349 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.674578 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.674707 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.674847 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.674974 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.675109 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.675236 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.675369 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.675495 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.675627 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.675754 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.675893 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.676020 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.676146 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.676279 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.676447 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.676586 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.676725 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.676854 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.677028 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.677160 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.677346 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.677477 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.677643 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.677773 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.677942 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.678079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.678242 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.678382 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.678564 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.678697 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.678853 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.678979 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.679150 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.679300 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.679490 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.679627 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.679792 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.679923 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.680116 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.680256 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.680431 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.680560 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.680736 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.680874 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.681043 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.681188 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.681350 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.681478 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.681651 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.681787 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.681959 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.682091 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.682261 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.682401 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.682598 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.682729 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.682903 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.683044 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.683207 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.683338 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.683528 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.683659 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.683833 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.683962 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.684136 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.684283 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.684473 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.684614 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.684812 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.684941 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.685067 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.685201 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.685336 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.685462 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.685657 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.685789 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.685959 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.686089 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.686264 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.686530 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.686670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.686803 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.686930 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.687056 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.687748 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.687885 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.688019 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.688145 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.688314 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.688446 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.688623 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.688761 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.688930 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.689059 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.689233 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.689370 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.689539 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.689678 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.689842 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.689973 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.690144 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.690272 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.690465 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.690598 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.690768 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.690899 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.691075 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.691204 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.691380 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.691512 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.691680 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.691808 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.691983 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.692112 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.692284 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.692414 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.692588 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.692718 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.692890 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.693030 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.693308 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.693437 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.693612 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.693753 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.693913 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.694050 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.694205 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.694336 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.694555 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.694698 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.694846 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.695045 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.695181 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.695297 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.695433 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.695561 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.695737 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.695880 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.696120 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.696250 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.696433 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.696564 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.696737 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.696878 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.697039 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.697176 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.697337 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.697466 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.697636 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.697768 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.697943 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.698071 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.698243 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.698374 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.698559 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.698686 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.698859 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.698991 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.699160 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.699291 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.699473 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.699603 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.699770 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.699900 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.700088 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.700219 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.700464 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.700601 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.700791 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.700921 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.701093 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.701237 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.701470 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.701601 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.701789 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.701920 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.702094 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.702248 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.702432 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.702582 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.702763 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.702896 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.703086 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.703270 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.703401 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.703588 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.703721 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.703941 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.704078 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.704242 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.704382 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.704558 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.704694 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.704878 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.704981 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.705185 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.705285 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.705486 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.705584 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.705806 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.705905 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.706123 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.706230 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.706453 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.706568 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.706801 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.706901 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.707190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.707295 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.707505 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.707595 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.707811 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.707899 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.708128 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.708228 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.708435 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.708531 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.708740 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.708828 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.709042 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.709132 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.709349 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.709438 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.709653 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.709742 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.709955 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.710046 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.710273 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.710371 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.710672 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.710776 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.710911 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.711003 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.711219 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.711312 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.711525 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.711615 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.711825 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.711915 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.712126 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.712215 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.712436 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.712531 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.712735 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.712824 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.713055 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.713144 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.713365 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.713463 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.713674 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.713761 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.713977 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.714078 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.714277 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.714383 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.714619 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.714724 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.714923 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.715028 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.715227 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.715327 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.715530 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.715621 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.715847 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.715935 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.716162 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.716258 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.716477 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.716565 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.716798 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.716894 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.717124 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.717213 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.717432 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.717521 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.717743 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.717830 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.718073 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.718163 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.718935 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.719035 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.719252 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.719339 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.719567 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.719656 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.719867 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.720004 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.720170 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.720273 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.720468 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.720556 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.720772 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.720872 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.721068 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.721166 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.721367 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.721462 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.721666 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.721761 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.721964 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.722065 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.722262 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.722350 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.722583 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.722674 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.722883 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.722986 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.723201 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.723297 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.723499 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.723588 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.723816 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.723912 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.724120 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.724217 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.724419 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.724506 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.724717 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.724803 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.725018 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.725508 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.725508 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.725668 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.725763 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.725943 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.726041 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.726262 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.726350 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.726597 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.726751 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.726912 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.727002 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.727226 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.727322 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.727537 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.727634 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.727846 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.727933 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.728156 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.728244 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.728468 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.728564 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.728775 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.728866 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.729087 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.729173 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.729394 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.729485 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.729705 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.729799 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.730014 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.730221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.730320 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.730571 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.730858 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.730972 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.731184 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.731287 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.731493 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.731582 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.731801 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.731896 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.732109 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.732206 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.732420 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.732508 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.732725 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.732820 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.733034 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.733130 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.733342 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.733431 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.733651 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.733740 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.734017 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.734731 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.734850 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.734987 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.735181 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.735280 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.735495 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.735586 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.735809 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.735898 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.736122 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.736224 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.736433 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.736522 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.736746 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.736835 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.737060 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.737157 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.737374 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.737471 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.737687 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.738039 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.738267 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.738367 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.738603 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.738694 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.738914 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.739013 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.739224 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.739313 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.739532 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.739627 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.739839 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.739927 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.740149 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.740239 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.740457 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.740558 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.740767 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.740874 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.741072 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.741165 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.741383 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.741473 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.741869 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.742017 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.742108 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.742325 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.742437 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.742663 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.742764 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.742976 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.743073 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.743284 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.743497 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.743594 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.743810 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.744099 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.744189 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.744412 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.744500 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.744743 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.744843 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.745055 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.745143 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.745371 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.745469 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.745694 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.745788 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.745998 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.746089 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.746300 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.746388 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.746646 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.746740 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.746954 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.747051 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.747257 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.747345 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.747561 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.747649 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.747863 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.747953 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.748163 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.748260 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.748476 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.748572 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.748777 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.748876 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.749092 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.749304 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.749395 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.749670 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.749939 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.750029 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.750283 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.750385 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.750623 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.750725 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.750936 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.751023 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.751243 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.751342 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.751555 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.751643 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.751857 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.751951 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.752159 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.752249 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.752463 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.752558 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.752766 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.752855 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.753071 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.753168 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.753374 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.753471 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.753673 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.753768 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.753974 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.754064 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.754274 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.754361 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.754604 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.754704 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.754904 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.755001 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.755210 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.755299 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.755512 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.755611 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.755812 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.755899 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.756113 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.756202 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.756412 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.756508 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.756711 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.756799 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.757012 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.757115 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.757317 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.757414 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.757614 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.757703 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.757911 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.757999 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.758209 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.758307 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.758540 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.758647 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.758841 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.758938 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.759146 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.759236 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.759446 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.759534 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.759752 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.759839 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.760050 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.760144 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.760355 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.760445 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.760695 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.760782 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.760995 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.761085 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.761304 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.761402 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.761605 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.761695 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.761916 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.762006 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.762222 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.762317 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.762557 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.762661 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.762865 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.762953 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.763171 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.763269 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.763513 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.763729 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.763829 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.764061 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.764339 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.764435 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.764667 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.764769 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.764986 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.765076 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.765333 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.765420 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.765639 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.765742 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.765946 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.766043 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.766248 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.766336 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.766576 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.766670 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.766886 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.766976 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.767196 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.767285 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.767503 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.767592 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.767820 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.767917 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.768113 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.768211 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.768418 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.768507 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.768724 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.768811 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.769027 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.769128 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.769332 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.769426 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.769636 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.769723 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.769953 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.770056 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.770249 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.770345 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.770584 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.770676 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.770899 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.771068 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.771215 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.771344 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.771529 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.771619 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.771845 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.771941 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.772159 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.772257 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.772470 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.772558 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.772775 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.772864 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.773084 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.773175 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.773390 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.773477 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.773695 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.773792 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.774003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.774100 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.774310 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.774400 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.774647 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.774738 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.774947 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.775034 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.775268 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.775365 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.775570 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.775659 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.775956 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.776044 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.776273 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.776376 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.776582 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.776672 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.776898 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.776993 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.777211 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.777309 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.777518 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.777605 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.777834 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.777921 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.778140 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.778229 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.778477 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.778570 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.778787 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.778877 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.779112 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.779202 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.779435 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.779523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.779737 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.779826 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.780039 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.780130 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.780340 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.780429 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.780639 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.780741 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.781612 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.781713 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.781798 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.781879 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.782106 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.782204 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.782422 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.782515 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.782735 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.782823 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.783034 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.783136 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.783339 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.783428 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.783637 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.783724 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.783936 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.784037 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.784237 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.784328 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.784534 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.784621 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.784834 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.784925 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.785130 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.785225 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.785427 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.785515 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.785725 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.785820 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.786019 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.786113 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.786314 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.786429 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.786636 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.786735 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.786938 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.787028 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.787235 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.787322 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.787534 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.787669 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.787833 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.787931 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.788130 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.788230 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.788429 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.788520 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.788755 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.788852 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.789076 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.789174 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.789382 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.789472 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.789699 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.789787 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.790004 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.790101 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.790318 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.790453 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.790650 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.790740 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.790961 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.791050 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.791268 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.791359 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.791578 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.791665 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.791885 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.791976 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.792238 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.792341 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.792501 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.792592 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.792807 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.792896 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.793116 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.793206 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.793421 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.793508 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.793727 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.793816 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.794035 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.794124 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.794350 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.794470 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.794695 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.794785 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.794997 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.795134 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.795317 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.795417 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.795628 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.795723 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.795936 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.796023 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.796245 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.796342 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.797090 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.797200 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.797416 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.797523 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.797732 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.797823 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.798040 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.798128 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.798347 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.798455 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.798680 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.798770 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.798988 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.799083 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.799299 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.799388 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.799603 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.799692 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.799912 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.800001 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.800225 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.800389 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.800538 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.800628 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.800844 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.800933 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.801167 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.801269 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.801472 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.801567 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.801794 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.801891 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.802115 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.802217 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.802474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.802570 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.802784 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.802872 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.803108 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.803209 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.803419 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.803509 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.803722 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.803812 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.803966 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:20:46.804057 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.804315 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:20:46.804557 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:20:46.956277 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO dbcounter [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Registered counter for database nova_api Sep 01 05:20:46.959436 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO dbcounter [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Registered counter for database nova_api Sep 01 05:20:46.978065 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_db.sqlalchemy.engines [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:20:46.979446 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_db.sqlalchemy.engines [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:20:46.985429 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writer thread running {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:20:46.986320 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writer thread running {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:20:47.042207 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.context [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7e5ccc8b-02a9-4328-be92-9856163a41bd(cell1) {{(pid=105832) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:20:47.042495 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.context [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7e5ccc8b-02a9-4328-be92-9856163a41bd(cell1) {{(pid=105833) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:20:47.046035 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.046152 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.046567 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.046668 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.048647 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.048790 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.049373 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.049510 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:20:47.049824 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.049939 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:20:47.051831 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_concurrency.lockutils [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.051928 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:20:47.053882 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO dbcounter [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Registered counter for database nova_cell0 Sep 01 05:20:47.053985 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO dbcounter [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Registered counter for database nova_cell0 Sep 01 05:20:47.057833 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO dbcounter [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Registered counter for database nova_cell1 Sep 01 05:20:47.058129 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO dbcounter [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Registered counter for database nova_cell1 Sep 01 05:20:47.064710 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_db.sqlalchemy.engines [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:20:47.066950 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_db.sqlalchemy.engines [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:20:47.068675 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_db.sqlalchemy.engines [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:20:47.069891 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_db.sqlalchemy.engines [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:20:47.072475 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writer thread running {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:20:47.074703 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writer thread running {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:20:47.076397 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writer thread running {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:20:47.079161 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writer thread running {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:20:47.216195 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO dbcounter [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Registered counter for database nova_cell0 Sep 01 05:20:47.222580 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO dbcounter [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Registered counter for database nova_cell0 Sep 01 05:20:47.223311 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_db.sqlalchemy.engines [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:20:47.227862 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writer thread running {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:20:47.231167 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG oslo_db.sqlalchemy.engines [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:20:47.235744 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writer thread running {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:20:47.625254 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: WARNING keystonemiddleware.auth_token [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:20:47.632602 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: WARNING keystonemiddleware.auth_token [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:20:47.635534 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: WARNING keystonemiddleware.auth_token [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:20:47.643363 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: WARNING keystonemiddleware.auth_token [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:20:47.980823 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: WARNING keystonemiddleware.auth_token [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:20:47.981205 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: WARNING keystonemiddleware.auth_token [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:20:47.987229 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: WARNING keystonemiddleware.auth_token [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:20:47.987592 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: WARNING keystonemiddleware.auth_token [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:20:47.992713 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df33d709c0 pid: 105832 (default app) Sep 01 05:20:47.993033 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df33d709c0 pid: 105833 (default app) Sep 01 05:20:47.994810 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:20:47.996003 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-682218ac-9445-49c0-9d92-35b660818bf8 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001774 Sep 01 05:20:47.996416 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Thu Sep 1 05:20:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:07.096116 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:07.097367 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Sep 01 05:22:07.097847 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:07.109538 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:SELECT=3 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:07.111017 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_cell0:SELECT=3 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:07.111986 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_cell1:SELECT=3 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:07.112946 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:07.977592 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-ced985dd-71c7-45da-ab67-4c5a4b4755a3 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:08.010125 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-ced985dd-71c7-45da-ab67-4c5a4b4755a3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.906185 Sep 01 05:22:08.011594 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 1 05:22:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:10.344380 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:10.345409 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-ed750951-8f0e-4e13-a2d9-d1cd872d5baa None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 01 05:22:10.345966 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 2/4] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:10.765064 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-8e8f1920-4333-4fbb-8163-9406f1e22b87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1, "disk": 1, "id": "c1", "name": "cirros256", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:10.875448 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-8e8f1920-4333-4fbb-8163-9406f1e22b87 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.523533 Sep 01 05:22:10.878750 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 3/5] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:10.889765 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_api:SELECT=3 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:10.890619 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_cell1:SELECT=3 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:10.891557 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_cell0:SELECT=3 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:10.892672 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:11.103344 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-71d8ea74-7922-4dfb-b941-0bd7d4b9a31e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:11.241575 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-71d8ea74-7922-4dfb-b941-0bd7d4b9a31e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.356944 Sep 01 05:22:11.242212 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 3/6] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 05:22:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:13.586763 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-8e8f1920-4333-4fbb-8163-9406f1e22b87 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:13.587784 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-8e8f1920-4333-4fbb-8163-9406f1e22b87 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 01 05:22:13.588200 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 4/7] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:14.253699 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-ff3c4faa-71d5-4022-a2b7-a0a2ed1cb9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "swap": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:14.351244 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-ff3c4faa-71d5-4022-a2b7-a0a2ed1cb9a4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.756703 Sep 01 05:22:14.352185 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 4/8] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:14.364755 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-b00a46d1-4fb2-4ae6-ae05-0861d81498d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:14.468429 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-b00a46d1-4fb2-4ae6-ae05-0861d81498d6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107798 Sep 01 05:22:14.469168 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 5/9] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 05:22:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:16.792432 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-ff3c4faa-71d5-4022-a2b7-a0a2ed1cb9a4 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:16.793467 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-ff3c4faa-71d5-4022-a2b7-a0a2ed1cb9a4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 01 05:22:16.793865 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:17.195326 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-ba6f99e9-d8fd-40d6-ac77-6ead6c14430b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 10}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:17.274374 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-ba6f99e9-d8fd-40d6-ac77-6ead6c14430b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474503 Sep 01 05:22:17.274962 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 6/11] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:17.287537 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-ab4327e0-b690-4705-a00e-79c764021aea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:17.387345 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-ab4327e0-b690-4705-a00e-79c764021aea admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103762 Sep 01 05:22:17.387934 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 6/12] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 05:22:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:19.712517 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-ba6f99e9-d8fd-40d6-ac77-6ead6c14430b admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:19.713948 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-ba6f99e9-d8fd-40d6-ac77-6ead6c14430b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Sep 01 05:22:19.714568 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 7/13] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:20.120386 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-2d99acc5-d07d-4ea7-9608-712764aec035 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "swap": 0, "name": "ds2G", "vcpus": 2, "disk": 10}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:20.224058 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-2d99acc5-d07d-4ea7-9608-712764aec035 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.503318 Sep 01 05:22:20.225064 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 7/14] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:20.237250 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-148504ec-5f08-4831-bcfc-f9d5be15d108 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:20.336698 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-148504ec-5f08-4831-bcfc-f9d5be15d108 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103464 Sep 01 05:22:20.337441 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 8/15] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 05:22:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:22.695390 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-2d99acc5-d07d-4ea7-9608-712764aec035 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:22.697102 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-2d99acc5-d07d-4ea7-9608-712764aec035 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 Sep 01 05:22:22.697682 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 8/16] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:23.112386 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-bd754b09-9a9b-4961-a14f-f3fa65595bc7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "id": "d4"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:23.199683 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-bd754b09-9a9b-4961-a14f-f3fa65595bc7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495858 Sep 01 05:22:23.200583 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 9/17] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:23.212411 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-74b639eb-7574-4259-840e-0273cea37b5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:23.313442 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-74b639eb-7574-4259-840e-0273cea37b5e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104650 Sep 01 05:22:23.314468 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 9/18] 10.222.0.16 () {64 vars in 1336 bytes} [Thu Sep 1 05:22:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:22:26.017890 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-bd754b09-9a9b-4961-a14f-f3fa65595bc7 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:26.018869 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-bd754b09-9a9b-4961-a14f-f3fa65595bc7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Sep 01 05:22:26.019272 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 10/19] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:26.450013 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-fe239483-2286-4a8a-8a91-8b839d11ce75 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:26.474436 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-fe239483-2286-4a8a-8a91-8b839d11ce75 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447196 Sep 01 05:22:26.474997 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 10/20] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 1 05:22:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:22:28.900857 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-bd754b09-9a9b-4961-a14f-f3fa65595bc7 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:28.901929 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-bd754b09-9a9b-4961-a14f-f3fa65595bc7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Sep 01 05:22:28.902350 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 11/21] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:29.316751 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-4c9e61e0-788e-44bf-912f-56c374d7af93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "vcpus": 1, "disk": 1, "name": "m1.tiny"}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:29.391735 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-4c9e61e0-788e-44bf-912f-56c374d7af93 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.481383 Sep 01 05:22:29.392557 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 11/22] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:29.408717 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-5ee10b0d-184f-4292-adbb-de7e54216690 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:29.501595 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-5ee10b0d-184f-4292-adbb-de7e54216690 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097776 Sep 01 05:22:29.502150 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 12/23] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 05:22:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:31.812910 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-4c9e61e0-788e-44bf-912f-56c374d7af93 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:31.813909 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-4c9e61e0-788e-44bf-912f-56c374d7af93 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Sep 01 05:22:31.814300 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:32.209981 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-bbe18c5b-806a-4b2d-acb0-0e2a5df5750d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:32.273761 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-bbe18c5b-806a-4b2d-acb0-0e2a5df5750d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453301 Sep 01 05:22:32.274414 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 13/25] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:32.286772 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-27d0fb65-321e-4a72-8d32-d63a640661d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:32.363762 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-27d0fb65-321e-4a72-8d32-d63a640661d9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080644 Sep 01 05:22:32.364341 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 13/26] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 05:22:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:34.711689 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-bbe18c5b-806a-4b2d-acb0-0e2a5df5750d admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:34.713210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-bbe18c5b-806a-4b2d-acb0-0e2a5df5750d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Sep 01 05:22:34.713609 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:35.144124 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-2b4aa26c-dfdc-4f10-8825-324863beadd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "vcpus": 2, "id": "3", "rxtx_factor": 1.0, "swap": 0}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:35.252255 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-2b4aa26c-dfdc-4f10-8825-324863beadd6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.532567 Sep 01 05:22:35.252806 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 14/28] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:35.264987 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-417980f5-1de7-460f-b6a4-875b89de90fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:35.364322 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-417980f5-1de7-460f-b6a4-875b89de90fb admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103114 Sep 01 05:22:35.364977 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 15/29] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 05:22:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:37.736002 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-2b4aa26c-dfdc-4f10-8825-324863beadd6 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:37.736935 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-2b4aa26c-dfdc-4f10-8825-324863beadd6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 01 05:22:37.737489 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 15/30] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:38.197970 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-1dee63f3-8891-4471-a996-6bba0204d3f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "swap": 0, "name": "m1.large", "id": "4", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:38.212904 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:39.105716 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-1dee63f3-8891-4471-a996-6bba0204d3f2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.362031 Sep 01 05:22:39.106930 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 16/31] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:39.121646 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-6c1a6c38-3c99-4ce8-a697-3c686b793acc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:39.195787 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-6c1a6c38-3c99-4ce8-a697-3c686b793acc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077830 Sep 01 05:22:39.197104 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 16/32] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 05:22:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:22:41.560477 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-1dee63f3-8891-4471-a996-6bba0204d3f2 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:22:41.561493 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-1dee63f3-8891-4471-a996-6bba0204d3f2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 01 05:22:41.561990 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 17/33] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:22:42.023046 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-aaec771a-6a1c-4c90-9ef7-c95fbbca4454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:42.031447 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:42.097063 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-aaec771a-6a1c-4c90-9ef7-c95fbbca4454 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.529023 Sep 01 05:22:42.098566 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 17/34] 10.222.0.16 () {64 vars in 1283 bytes} [Thu Sep 1 05:22:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:22:42.110153 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-0143064d-45c0-47cb-963e-241eede9c06b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:22:42.207926 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-0143064d-45c0-47cb-963e-241eede9c06b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101773 Sep 01 05:22:42.208808 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 18/35] 10.222.0.16 () {64 vars in 1333 bytes} [Thu Sep 1 05:22:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:23:00.572653 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-aaec771a-6a1c-4c90-9ef7-c95fbbca4454 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:00.573723 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-aaec771a-6a1c-4c90-9ef7-c95fbbca4454 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 01 05:23:00.574149 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 18/36] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:00.958672 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-e7fdd42f-da80-4c5d-9fa8-5ad2c1568b53 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:00.978871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-e7fdd42f-da80-4c5d-9fa8-5ad2c1568b53 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398672 Sep 01 05:23:00.979405 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 19/37] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 1 05:23:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:02.024493 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-aaec771a-6a1c-4c90-9ef7-c95fbbca4454 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:02.025521 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-aaec771a-6a1c-4c90-9ef7-c95fbbca4454 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 05:23:02.025925 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 19/38] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:02.659133 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7fd3565e-ab71-4104-890e-8e758fc87105 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:02.665263 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.wsgi [None req-7fd3565e-ab71-4104-890e-8e758fc87105 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7fd3565e-ab71-4104-890e-8e758fc87105 admin admin] Request method failure captured: Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Accept: application/json Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Accept-Encoding: gzip, deflate Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Connection: keep-alive Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Content-Length: 0 Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Host: 10.222.0.16 Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Openstack-Api-Version: compute 2.90 Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Openstack-System-Scope: None Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: User-Agent: python-novaclient Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Auth-Token: gAAAAABjEEG1OfmnAv-BKjWERmMRotlKmlat0S858S8mjO-Oc170vxRlZrr-lyXaHeKr3YmFhc46m2vZg7Upag9_49o9WfUYF4tdjFez9uTmSstbN6I7mxkXd76ZhHe2wX6ChjFT9riw0AJhAw1OXo3kQZZhoNPLsaPb8oCb_2mujKWva87Ixy0 Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Domain-Id: None Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Domain-Name: None Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Identity-Status: Confirmed Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Is-Admin-Project: True Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Domain-Id: default Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Domain-Name: Default Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Name: admin Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Role: admin,member,reader Sep 01 05:23:02.668474 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Roles: admin,member,reader Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant: admin Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant-Name: admin Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User: admin Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Domain-Id: default Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Domain-Name: Default Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Id: ad7989abb40e4e979f3e309692f0a847 Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Name: admin Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: method: > Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: exception: Flavor 42 could not be found. Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: action_args: {'id': '42'} Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:23:02.670190 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:02.671135 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.672388 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7fd3565e-ab71-4104-890e-8e758fc87105 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:23:02.673468 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-7fd3565e-ab71-4104-890e-8e758fc87105 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.505678 Sep 01 05:23:02.673468 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 20/39] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 1 05:23:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 507 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:02.679489 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-e3f51163-82bd-4ae9-9284-d2bdf582dd1c admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:02.712956 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-e3f51163-82bd-4ae9-9284-d2bdf582dd1c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026798 Sep 01 05:23:02.712956 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 05:23:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:23:02.713276 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-45fba7e5-5d03-4bfa-8b70-cb255b3671cc admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:02.736217 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-45fba7e5-5d03-4bfa-8b70-cb255b3671cc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027012 Sep 01 05:23:02.736748 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 21/41] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 05:23:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:02.746005 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-95c6d095-0387-4c37-b5ed-85f3d431768f admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:02.752095 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.wsgi [None req-95c6d095-0387-4c37-b5ed-85f3d431768f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-95c6d095-0387-4c37-b5ed-85f3d431768f admin admin] Request method failure captured: Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Accept: application/json Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Accept-Encoding: gzip, deflate Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Connection: keep-alive Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Content-Length: 0 Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Host: 10.222.0.16 Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Openstack-Api-Version: compute 2.90 Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Openstack-System-Scope: None Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: User-Agent: python-novaclient Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Auth-Token: gAAAAABjEEG1OfmnAv-BKjWERmMRotlKmlat0S858S8mjO-Oc170vxRlZrr-lyXaHeKr3YmFhc46m2vZg7Upag9_49o9WfUYF4tdjFez9uTmSstbN6I7mxkXd76ZhHe2wX6ChjFT9riw0AJhAw1OXo3kQZZhoNPLsaPb8oCb_2mujKWva87Ixy0 Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Domain-Id: None Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Domain-Name: None Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Identity-Status: Confirmed Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Is-Admin-Project: True Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Domain-Id: default Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Domain-Name: Default Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Name: admin Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Role: admin,member,reader Sep 01 05:23:02.755375 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Roles: admin,member,reader Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant: admin Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant-Name: admin Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User: admin Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Domain-Id: default Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Domain-Name: Default Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Id: ad7989abb40e4e979f3e309692f0a847 Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Name: admin Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: method: > Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: exception: Flavor 42 could not be found. Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: action_args: {'id': '42'} Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:23:02.757009 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:02.758200 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:02.771670 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-95c6d095-0387-4c37-b5ed-85f3d431768f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:23:02.773561 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-95c6d095-0387-4c37-b5ed-85f3d431768f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014325 Sep 01 05:23:02.773561 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 21/42] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 1 05:23:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:03.704050 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-45fba7e5-5d03-4bfa-8b70-cb255b3671cc admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:03.705057 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-45fba7e5-5d03-4bfa-8b70-cb255b3671cc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 01 05:23:03.705450 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:04.215716 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-af3ceab3-f221-4294-9f51-e427426d96e6 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.220958 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.wsgi [None req-af3ceab3-f221-4294-9f51-e427426d96e6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-af3ceab3-f221-4294-9f51-e427426d96e6 admin admin] Request method failure captured: Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Accept: application/json Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Accept-Encoding: gzip, deflate Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Connection: keep-alive Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Content-Length: 0 Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Host: 10.222.0.16 Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Openstack-Api-Version: compute 2.90 Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Openstack-System-Scope: None Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: User-Agent: python-novaclient Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Auth-Token: gAAAAABjEEG3kceRAY73DnyRkBG11hUXC29WhhEqE-6INSvib4dW2kczVTB3gx-maZRfO5beOF7WsouMakr7px28xDaQHuyg2dzFIy8r8Ri-V9fgpeSgVrkCr3zhNSrKu3SvaxzHAkbyyNmg55QYNVOKVj9Cy30PUJYG5y8p3aHiM2SH3TsJITk Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Domain-Id: None Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Domain-Name: None Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Identity-Status: Confirmed Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Is-Admin-Project: True Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Domain-Id: default Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Domain-Name: Default Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Name: admin Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Role: admin,member,reader Sep 01 05:23:04.222505 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Roles: admin,member,reader Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant: admin Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant-Name: admin Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User: admin Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Domain-Id: default Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Domain-Name: Default Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Id: ad7989abb40e4e979f3e309692f0a847 Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Name: admin Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: method: > Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: exception: Flavor 84 could not be found. Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: action_args: {'id': '84'} Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:23:04.224107 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:04.225079 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.227003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-af3ceab3-f221-4294-9f51-e427426d96e6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:23:04.228294 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-af3ceab3-f221-4294-9f51-e427426d96e6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.382831 Sep 01 05:23:04.228294 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 1 05:23:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:04.234155 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-f4021e1d-5a3c-4324-825d-a99d8dca5bb4 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.248952 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-f4021e1d-5a3c-4324-825d-a99d8dca5bb4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018586 Sep 01 05:23:04.249465 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 23/45] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 05:23:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:04.258345 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-384f626f-0170-49a3-b10a-807c17ef2b0b admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.273524 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-384f626f-0170-49a3-b10a-807c17ef2b0b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018066 Sep 01 05:23:04.274046 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 05:23:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:04.282917 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7f165f84-e436-490e-bf01-587e0b76ac97 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:04.288104 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.wsgi [None req-7f165f84-e436-490e-bf01-587e0b76ac97 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7f165f84-e436-490e-bf01-587e0b76ac97 admin admin] Request method failure captured: Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Accept: application/json Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Accept-Encoding: gzip, deflate Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Connection: keep-alive Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Content-Length: 0 Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Host: 10.222.0.16 Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Openstack-Api-Version: compute 2.90 Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Openstack-System-Scope: None Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: User-Agent: python-novaclient Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Auth-Token: gAAAAABjEEG3kceRAY73DnyRkBG11hUXC29WhhEqE-6INSvib4dW2kczVTB3gx-maZRfO5beOF7WsouMakr7px28xDaQHuyg2dzFIy8r8Ri-V9fgpeSgVrkCr3zhNSrKu3SvaxzHAkbyyNmg55QYNVOKVj9Cy30PUJYG5y8p3aHiM2SH3TsJITk Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Domain-Id: None Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Domain-Name: None Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Identity-Status: Confirmed Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Is-Admin-Project: True Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Domain-Id: default Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Domain-Name: Default Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Name: admin Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Role: admin,member,reader Sep 01 05:23:04.290210 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Roles: admin,member,reader Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant: admin Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant-Name: admin Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User: admin Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Domain-Id: default Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Domain-Name: Default Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Id: ad7989abb40e4e979f3e309692f0a847 Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Name: admin Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: method: > Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: exception: Flavor 84 could not be found. Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: action_args: {'id': '84'} Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:23:04.291871 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:04.292906 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:04.294212 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-7f165f84-e436-490e-bf01-587e0b76ac97 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:23:04.295490 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-7f165f84-e436-490e-bf01-587e0b76ac97 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012061 Sep 01 05:23:04.295490 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 24/47] 10.222.0.16 () {60 vars in 1190 bytes} [Thu Sep 1 05:23:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 05:23:05.243119 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-384f626f-0170-49a3-b10a-807c17ef2b0b admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.244123 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-384f626f-0170-49a3-b10a-807c17ef2b0b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 01 05:23:05.244513 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 24/48] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:05.759380 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-95cbc109-394e-443b-a591-de9cdc2627c5 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.765088 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.wsgi [None req-95cbc109-394e-443b-a591-de9cdc2627c5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-95cbc109-394e-443b-a591-de9cdc2627c5 admin admin] Request method failure captured: Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Accept: application/json Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Accept-Encoding: gzip, deflate Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Connection: keep-alive Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Content-Length: 0 Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Host: 10.222.0.16 Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Openstack-Api-Version: compute 2.90 Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Openstack-System-Scope: None Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: User-Agent: python-novaclient Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Auth-Token: gAAAAABjEEG5dIU3_NHRFi7gro3dSwBLHZ9orDJN1tTMQgmMsD2iI5M1qMKiVpF-6XdqF5Gvkde482dev2p_0EIFsEMzyJsP4N7zx7yIN0SrlpDtWbPLzCeQ1EblmdtksAtgPwCVRnnl3Rx2wU93O6ij_il5u2Fy8J5oEpQWHOe-k9tKohIzQAE Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Domain-Id: None Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Domain-Name: None Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Identity-Status: Confirmed Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Is-Admin-Project: True Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Domain-Id: default Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Domain-Name: Default Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Project-Name: admin Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Role: admin,member,reader Sep 01 05:23:05.766660 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Roles: admin,member,reader Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant: admin Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-Tenant-Name: admin Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User: admin Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Domain-Id: default Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Domain-Name: Default Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Id: ad7989abb40e4e979f3e309692f0a847 Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: X-User-Name: admin Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: method: > Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: exception: Flavor 451 could not be found. Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: action_args: {'id': '451'} Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:23:05.768005 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:05.768819 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.770221 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-95cbc109-394e-443b-a591-de9cdc2627c5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:23:05.771495 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-95cbc109-394e-443b-a591-de9cdc2627c5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.384400 Sep 01 05:23:05.771495 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 25/49] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:05.778070 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-d25288aa-a0e8-409f-9a18-1f94fc0de59a admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.793541 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-d25288aa-a0e8-409f-9a18-1f94fc0de59a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019074 Sep 01 05:23:05.794064 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 25/50] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:05.803178 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.817637 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017872 Sep 01 05:23:05.818142 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 26/51] 10.222.0.16 () {60 vars in 1210 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:23:05.827710 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-db8ddb44-96a1-48a8-a67c-fc2b483c569c admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:05.833111 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.wsgi [None req-db8ddb44-96a1-48a8-a67c-fc2b483c569c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-db8ddb44-96a1-48a8-a67c-fc2b483c569c admin admin] Request method failure captured: Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Accept: application/json Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Accept-Encoding: gzip, deflate Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Connection: keep-alive Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Content-Length: 0 Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Host: 10.222.0.16 Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Openstack-Api-Version: compute 2.90 Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Openstack-System-Scope: None Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: User-Agent: python-novaclient Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Auth-Token: gAAAAABjEEG5dIU3_NHRFi7gro3dSwBLHZ9orDJN1tTMQgmMsD2iI5M1qMKiVpF-6XdqF5Gvkde482dev2p_0EIFsEMzyJsP4N7zx7yIN0SrlpDtWbPLzCeQ1EblmdtksAtgPwCVRnnl3Rx2wU93O6ij_il5u2Fy8J5oEpQWHOe-k9tKohIzQAE Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Domain-Id: None Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Domain-Name: None Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Identity-Status: Confirmed Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Is-Admin-Project: True Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Domain-Id: default Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Domain-Name: Default Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Project-Name: admin Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Role: admin,member,reader Sep 01 05:23:05.834640 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Roles: admin,member,reader Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd94b8179b9d4ba6806f99509678d7fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant: admin Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant-Id: fd94b8179b9d4ba6806f99509678d7fb Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-Tenant-Name: admin Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User: admin Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Domain-Id: default Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Domain-Name: Default Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Id: ad7989abb40e4e979f3e309692f0a847 Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: X-User-Name: admin Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: method: > Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: exception: Flavor 451 could not be found. Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: action_args: {'id': '451'} Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:23:05.836626 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:05.837523 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: ERROR nova.api.openstack.wsgi Sep 01 05:23:05.838645 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-db8ddb44-96a1-48a8-a67c-fc2b483c569c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:23:05.839704 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-db8ddb44-96a1-48a8-a67c-fc2b483c569c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012404 Sep 01 05:23:05.839704 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 26/52] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 05:23:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 05:23:06.787345 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:06.788854 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 01 05:23:06.789250 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:23:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:07.308570 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-b24587ef-7938-4efe-9dd1-97cfb8017f6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:07.369249 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-b24587ef-7938-4efe-9dd1-97cfb8017f6c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.443485 Sep 01 05:23:07.369778 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 27/54] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 1 05:23:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:23:08.321650 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:08.322692 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 01 05:23:08.323089 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:08.835602 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-69c003f4-55e6-44f1-ad43-bc6836e8f8ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:08.923570 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-69c003f4-55e6-44f1-ad43-bc6836e8f8ad admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.466175 Sep 01 05:23:08.924122 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 28/56] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 1 05:23:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:09.899641 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:09.900642 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 01 05:23:09.901037 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 29/57] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:10.415676 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-32dabecd-3a0a-4da5-8e7c-1e6f76d6b424 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:10.504518 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-32dabecd-3a0a-4da5-8e7c-1e6f76d6b424 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.464972 Sep 01 05:23:10.505003 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 29/58] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 1 05:23:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:11.461930 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:11.462984 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 01 05:23:11.463390 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 30/59] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:11.992907 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-3133783c-dd23-4613-aabd-ec0628f7103c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:23:12.064509 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-3133783c-dd23-4613-aabd-ec0628f7103c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.463420 Sep 01 05:23:12.065134 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 30/60] 10.222.0.16 () {64 vars in 1235 bytes} [Thu Sep 1 05:23:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:13.025053 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:13.026090 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 01 05:23:13.026541 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 31/61] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:23:13.540804 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-b2a1c86d-1116-45f4-afaf-ed7876a0edb6 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:23:13.561921 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-b2a1c86d-1116-45f4-afaf-ed7876a0edb6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401515 Sep 01 05:23:13.562479 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 31/62] 10.222.0.16 () {60 vars in 1202 bytes} [Thu Sep 1 05:23:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:24:06.497615 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.498723 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-9287bc69-080b-4194-bee6-dc911f3c702b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Sep 01 05:24:06.499129 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 931 bytes} [Thu Sep 1 05:24:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:24:06.510218 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:06.882449 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-b4880589-341b-4536-a55b-517272dc9fde admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.903309 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-b4880589-341b-4536-a55b-517272dc9fde admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398065 Sep 01 05:24:06.903843 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 32/64] 10.222.0.16 () {60 vars in 1292 bytes} [Thu Sep 1 05:24:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:24:06.924746 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG dbcounter [-] [105832] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:24:06.928469 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-492b5b01-7ce5-469f-9e46-8444a3b04ad2 admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.935909 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-492b5b01-7ce5-469f-9e46-8444a3b04ad2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012760 Sep 01 05:24:06.938618 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 33/65] 10.222.0.16 () {60 vars in 1283 bytes} [Thu Sep 1 05:24:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:06.948204 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-522722a4-2c4a-4e0a-8515-3aa702dfd9e1 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.955707 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-522722a4-2c4a-4e0a-8515-3aa702dfd9e1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011015 Sep 01 05:24:06.956974 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 33/66] 10.222.0.16 () {60 vars in 1286 bytes} [Thu Sep 1 05:24:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:06.968275 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.976144 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011406 Sep 01 05:24:06.976674 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 34/67] 10.222.0.16 () {60 vars in 1286 bytes} [Thu Sep 1 05:24:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:24:06.989382 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-22116779-c264-442c-abfe-e4a9d0cee199 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:24:06.997088 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-22116779-c264-442c-abfe-e4a9d0cee199 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012040 Sep 01 05:24:06.997617 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 34/68] 10.222.0.16 () {60 vars in 1283 bytes} [Thu Sep 1 05:24:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:27:18.036841 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:18.037844 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 01 05:27:18.038268 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:27:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:18.178925 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_api:SELECT=6 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:18.337544 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-e6459b6b-01be-4bf1-bcc6-6437277e4eb7 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:18.341214 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-e6459b6b-01be-4bf1-bcc6-6437277e4eb7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:18.341939 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-e6459b6b-01be-4bf1-bcc6-6437277e4eb7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:18.342362 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-e6459b6b-01be-4bf1-bcc6-6437277e4eb7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:18.343205 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-e6459b6b-01be-4bf1-bcc6-6437277e4eb7 admin admin] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:18.343641 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-e6459b6b-01be-4bf1-bcc6-6437277e4eb7 admin admin] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:18.344053 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-e6459b6b-01be-4bf1-bcc6-6437277e4eb7 admin admin] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:18.377623 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-e6459b6b-01be-4bf1-bcc6-6437277e4eb7 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200176 Sep 01 05:27:18.378167 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 35/70] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 05:27:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:27:19.214354 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:19.215376 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 01 05:27:19.215772 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:27:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:19.405458 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-72589c0f-02ce-49ba-ac39-92948953cded admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:19.409577 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-72589c0f-02ce-49ba-ac39-92948953cded admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:19.410071 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-72589c0f-02ce-49ba-ac39-92948953cded admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:19.410530 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-72589c0f-02ce-49ba-ac39-92948953cded admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:19.411249 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-72589c0f-02ce-49ba-ac39-92948953cded admin admin] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:19.411704 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-72589c0f-02ce-49ba-ac39-92948953cded admin admin] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:19.412145 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-72589c0f-02ce-49ba-ac39-92948953cded admin admin] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:19.432391 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-72589c0f-02ce-49ba-ac39-92948953cded admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078047 Sep 01 05:27:19.432883 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 36/72] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 05:27:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:27:30.657626 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:30.658691 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Sep 01 05:27:30.659101 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:27:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:30.802112 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_cell0:SELECT=4 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:30.802860 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_cell1:SELECT=4 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:30.803458 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG dbcounter [-] [105833] Writing DB stats nova_api:SELECT=8 {{(pid=105833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:27:30.850978 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-d18777e4-cc8b-4c3a-9402-dc87f67bb6cf admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:30.854309 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-d18777e4-cc8b-4c3a-9402-dc87f67bb6cf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:30.854815 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-d18777e4-cc8b-4c3a-9402-dc87f67bb6cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:30.855244 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-d18777e4-cc8b-4c3a-9402-dc87f67bb6cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:30.855951 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-d18777e4-cc8b-4c3a-9402-dc87f67bb6cf admin admin] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:30.856397 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-d18777e4-cc8b-4c3a-9402-dc87f67bb6cf admin admin] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:30.856812 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-d18777e4-cc8b-4c3a-9402-dc87f67bb6cf admin admin] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:30.882857 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-d18777e4-cc8b-4c3a-9402-dc87f67bb6cf admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085477 Sep 01 05:27:30.883339 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 37/74] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 05:27:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:27:31.708122 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: DEBUG nova.api.openstack.wsgi [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] Calling method '>' {{(pid=105832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:31.709157 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: INFO nova.api.openstack.requestlog [None req-f4afc426-150e-4f47-9473-13c89cc7277a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 01 05:27:31.709580 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: [pid: 105832|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1074 bytes} [Thu Sep 1 05:27:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:27:31.898634 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG nova.api.openstack.wsgi [None req-2cb807d7-5141-48bf-9871-d58936d519b7 admin admin] Calling method '>' {{(pid=105833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:27:31.902065 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-2cb807d7-5141-48bf-9871-d58936d519b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:31.902571 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-2cb807d7-5141-48bf-9871-d58936d519b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:31.903000 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-2cb807d7-5141-48bf-9871-d58936d519b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:31.903708 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-2cb807d7-5141-48bf-9871-d58936d519b7 admin admin] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:27:31.904156 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-2cb807d7-5141-48bf-9871-d58936d519b7 admin admin] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:27:31.904573 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: DEBUG oslo_concurrency.lockutils [None req-2cb807d7-5141-48bf-9871-d58936d519b7 admin admin] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:27:31.926765 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: INFO nova.api.openstack.requestlog [None req-2cb807d7-5141-48bf-9871-d58936d519b7 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079211 Sep 01 05:27:31.927311 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: [pid: 105833|app: 0|req: 38/76] 10.222.0.16 () {60 vars in 1193 bytes} [Thu Sep 1 05:27:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:28:29.156192 dv-cinder-836027-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 05:28:29.156887 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: Thu Sep 1 05:28:29 2022 - graceful shutdown triggered... Sep 01 05:28:29.157441 dv-cinder-836027-8-iscsi devstack@n-api.service[105832]: Gracefully killing worker 1 (pid: 105832)... Sep 01 05:28:29.157901 dv-cinder-836027-8-iscsi devstack@n-api.service[105833]: Gracefully killing worker 2 (pid: 105833)... Sep 01 05:28:30.158502 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: worker 1 buried after 1 seconds Sep 01 05:28:30.159070 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: worker 2 buried after 1 seconds Sep 01 05:28:30.159070 dv-cinder-836027-8-iscsi devstack@n-api.service[105831]: goodbye to uWSGI. Sep 01 05:28:30.160100 dv-cinder-836027-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 05:28:30.160643 dv-cinder-836027-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 05:28:30.163497 dv-cinder-836027-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 05:28:30.174524 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 05:28:30 2022] *** Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: nodename: dv-cinder-836027-8-iscsi Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: machine: x86_64 Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: clock source: unix Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: pcre jit disabled Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: detected number of CPU cores: 4 Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: current working directory: / Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: detected binary path: /usr/bin/uwsgi-core Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: your processes number limit is 47680 Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: your memory page size is 4096 bytes Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: detected max file descriptor number: 2048 Sep 01 05:28:30.177140 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: lock engine: pthread robust mutexes Sep 01 05:28:30.178215 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: thunder lock: enabled Sep 01 05:28:30.178215 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 05:28:30.178215 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 05:28:30.217418 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: Python main interpreter initialized at 0x55fa91eb49c0 Sep 01 05:28:30.217699 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: python threads support enabled Sep 01 05:28:30.217699 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: your server socket listen backlog is limited to 100 connections Sep 01 05:28:30.217699 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: your mercy for graceful operations on workers is 90 seconds Sep 01 05:28:30.218082 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 05:28:30.218190 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: *** Operational MODE: preforking *** Sep 01 05:28:30.218455 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: *** uWSGI is running in multiple interpreter mode *** Sep 01 05:28:30.218455 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: spawned uWSGI master process (pid: 121016) Sep 01 05:28:30.218655 dv-cinder-836027-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 05:28:30.218901 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: spawned uWSGI worker 1 (pid: 121030, cores: 1) Sep 01 05:28:30.219773 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: spawned uWSGI worker 2 (pid: 121031, cores: 1) Sep 01 05:28:30.219773 dv-cinder-836027-8-iscsi devstack@n-api.service[121016]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 05:28:30.875692 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:28:30.876319 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 05:28:32.027855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:28:32.027855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: from cryptography.utils import int_from_bytes Sep 01 05:28:32.028486 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:28:32.028486 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: from cryptography.utils import int_from_bytes Sep 01 05:28:32.031930 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:28:32.031930 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: from cryptography.utils import int_from_bytes Sep 01 05:28:32.032379 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:28:32.032379 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: from cryptography.utils import int_from_bytes Sep 01 05:28:34.455360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:28:34.456325 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:28:34.456895 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:28:34.457388 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:28:34.457701 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:28:34.458128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.458488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.458814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.459136 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.459469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.459780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.460165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.460908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.461272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.461463 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:28:34.461860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.461939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:28:34.462273 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.462526 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-8-iscsi {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.462648 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:28:34.462943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:28:34.463038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.463202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:28:34.463311 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.463594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.463697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.463913 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.464013 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.464272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.464372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.464642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.464767 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.464976 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.465079 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.465327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.465597 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.465730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.466270 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.466455 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.466612 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.466764 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.466895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.467020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.467177 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.467313 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.467419 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-8-iscsi {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.467581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.467783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.468008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.468190 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.468430 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.468604 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.468760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.468914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.469095 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.469291 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.469449 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.469606 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.469717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.470225 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.470562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.470743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-8-iscsi {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.470917 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.471103 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.471208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.471443 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.471590 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.471781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.471932 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.472098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.472298 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.472436 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.472561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.472716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.472831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.473041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.473160 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.473351 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.473519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.473750 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-8-iscsi {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.473857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.474066 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.474168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.474380 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.474487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.474746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.474877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.475140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.475255 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.475445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.475570 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.475756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.475867 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.476071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.476174 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.476395 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.476568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.476718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.476863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.476996 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.477091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.477246 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.477401 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.477576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.477707 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.477905 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.478077 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.478221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.478440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.478575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.478778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.478886 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.479033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.479143 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.479282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.479449 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.479603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.479757 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.479923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.480024 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.480231 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.480325 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.480539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.480633 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.480846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.480947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.481156 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.481275 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.481462 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.481564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.481709 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.481811 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.482029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.482131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.482351 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.482488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.482688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.482791 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.482997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.483097 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.483307 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.483414 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.483613 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.483751 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.483917 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.484008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.484223 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.484406 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.484531 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.484625 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.484842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.484953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.485159 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.485269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.485475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.485569 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.485781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.485870 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.486090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.486190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.486426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.486522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.486731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.486832 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.487036 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.487137 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.487341 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.487449 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.487663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.487769 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.487989 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.488101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.488303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.488418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.488622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.488733 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.488943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.489045 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.489247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.489346 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.489552 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.489660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.489860 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.489966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.490164 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.490263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.491011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.491123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.491312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.491414 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.491586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.491678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.491926 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.492038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.492230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.492364 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.492533 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.492665 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.492836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.492974 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.493157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.493287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.493466 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.493601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.493769 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.493898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.494089 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.494226 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.494447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.494587 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.494717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.494833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.495042 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.495164 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.495287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.495402 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.495569 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.495689 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.495912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.496068 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.496185 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.496298 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.497577 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.497694 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.497694 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.497921 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498225 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498311 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498419 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.498925 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.499023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.499023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.499023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.499304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.499509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.499650 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.499866 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.499998 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.500203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.500438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.500556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.500655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.500829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.500929 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.501141 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.501235 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.501460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.501574 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.501762 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.501867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.502067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.502170 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.502371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.502530 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.502704 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.502803 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.503006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.503111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.503309 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.503409 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.503607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.503704 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.503909 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.504009 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.504218 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.504319 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.504521 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.504621 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.504825 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.504929 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.505122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.505223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.505435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.505532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.505753 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.505857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.506688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.506812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.506948 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.507049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.507256 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.507356 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.507578 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:28:34.507678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.507918 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.508035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.508230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.508330 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.508541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.508695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.508881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.508975 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.509215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.509318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.509546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.509640 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.509865 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.509967 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.510173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.510271 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.510510 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.510607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.510826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.510931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.511138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.511238 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.511456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.511563 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.511770 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.511936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.512083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.512175 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.512393 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.512496 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.512710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.512812 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.513026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.513124 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.513344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.513443 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.513654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.513754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.513965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.514058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.514284 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.514385 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.514650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.514757 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.514970 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.515063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.515283 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.515374 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.515591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.515696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.515901 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.515993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.516209 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.516303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.516527 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.516634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.516859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.516972 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.517165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.517265 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.517479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.517585 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.517787 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.517879 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.518110 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.518214 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.518498 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.518623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.518821 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.518933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.519081 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.519183 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.519389 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.519489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.519697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.519797 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.520014 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.520106 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.520353 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.520436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.520667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.520763 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.520981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.521084 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.521296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.521391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.521633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.521736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.521946 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.522060 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.522237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.522334 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.522632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.522768 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.522895 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.523027 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.523199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.523329 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.523503 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.523632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.523810 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.523946 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.524125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.524247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.524445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.524573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.524771 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.524906 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.525076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.525196 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.525386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.525506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.525693 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.525827 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.525999 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.526117 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.526307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.526535 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.526670 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.526798 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.526936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.527147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.527265 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.527385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.527507 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.527627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.527808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.527912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.528616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.528730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.528829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.528928 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529102 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529185 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529374 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529467 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529738 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.529919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.530032 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.530230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.530328 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.530560 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.530735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.530894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.531057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.531162 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.531337 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.531515 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.531673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.531824 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.531990 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.532093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.532279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.532457 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.532612 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.532763 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.532927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.533021 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.533224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.533323 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.533538 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.533648 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.533852 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.533960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.534191 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.534290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.534549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.534664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.534849 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.534957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.535148 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.535247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.535448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.535556 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.535752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.535857 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.536050 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.536149 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.536350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.536459 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.536648 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.536748 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.536948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.537053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.537273 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.537385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.537790 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.537891 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.537975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.538049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.538305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.538521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.538521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.538885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.539120 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.539274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.539274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.539581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.539729 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.539874 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.540020 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.540166 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.540380 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.540541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.540705 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.540861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.541024 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.541171 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.541326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.541473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.541739 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.541891 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.542038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.542248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.542396 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.542568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.542725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.542882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.543036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.543198 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.543390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.543547 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.543693 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.543847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.544001 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.544162 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.544316 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.544464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.544609 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.544765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.544910 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.545069 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.545216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.545471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.545637 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.545785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.545945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.546098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.546245 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.546401 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.546609 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.546765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.546936 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.547092 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.547247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.547401 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.547667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.547964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.548127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.548283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.548532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.548695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.548931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.549108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.549336 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.549507 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.549656 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.549803 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.549948 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.550106 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.550265 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.550432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.550585 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.550732 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.550887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.551050 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.551197 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.551343 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.551511 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.551658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.551810 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.551966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.552126 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.552278 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.552424 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.552572 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.552724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.553381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.553530 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.553684 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.553838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.553995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.554141 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.554296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.554471 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.554626 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.554780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.554926 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.555085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.555232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.555232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.555525 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.555672 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.555828 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.555983 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.556272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.556466 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.556627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.556777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.556931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.557094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.557248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.557403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.557556 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.557808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.558089 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.558262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.558473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.558709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.558861 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.559094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.559264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.559503 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.559664 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.559813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.559968 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.560122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.560278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.560425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.560582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.560729 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.560877 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.561031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.561193 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.561348 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.561496 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.561649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.561803 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.561960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.562127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.562287 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.562453 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.562622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.562768 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.562932 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.563081 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.563235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.563381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.563527 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.563674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.563674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.563970 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.564116 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.564262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.564407 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.564572 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.564728 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.564877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.565030 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.565178 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.565323 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.565477 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.565632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.565780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.565934 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.566090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.566244 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.566429 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.566593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.566741 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.566886 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.567031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.567178 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.567338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.567494 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.567649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.567907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.568191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.568352 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.568552 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.569504 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.569736 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.569906 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.570070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.570248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.570486 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.570648 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.570802 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.570955 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.571108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.571271 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.571427 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.571586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.571765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.571927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.572081 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.572254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.572412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.572573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.572727 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.572879 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.573031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.573197 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.573358 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.573521 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.573682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.573682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.574007 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.574169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.574329 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.574550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.574722 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.574877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.575030 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.575191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.575344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.575509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.575744 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.575919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.576132 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.576305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.576469 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.576632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.576786 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.576945 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.577106 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.577269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.577423 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.577575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.577736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.578004 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.578317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.578514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.578674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.578829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.578981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.579135 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.579450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.579624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.579866 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.580026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.580180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.580332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.580500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.580675 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.580831 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.580993 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.581147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.581312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.581481 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.581635 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.581796 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.581951 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.582111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.582276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.582553 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.582717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.582884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.583038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.583190 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.583388 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.583564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.583720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.583872 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.584027 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.584211 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.584374 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.584528 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.584690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.584855 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.585010 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.585162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.585329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.585492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.585654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.585654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.585961 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.586116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.586282 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.586456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.586627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.586782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.587207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.587379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.587532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.587692 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.587844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.588112 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.588420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.588596 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.588758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.588920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.589080 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.589244 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.589425 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.589746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.589994 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.590163 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.590326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.590545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.590713 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.590879 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.591033 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.591184 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.591337 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.591488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.591648 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.591825 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.591988 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.592157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.592317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.592480 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.592647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.592802 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.592954 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.593121 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.593275 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.593436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.593599 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.593761 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.593926 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.594093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.594246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.594398 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.594591 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.594747 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.594899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.595130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.595291 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.595444 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.595608 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.595769 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.595922 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.596085 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.596246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.596416 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.596579 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.596733 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.596885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.597039 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.597199 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.597366 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.597520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.597674 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.597826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.597979 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.598255 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.598530 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.598706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.598862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.599023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.599185 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.599346 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.599510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.599878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.600132 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.600300 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.600456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.600623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.600799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.600799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.601106 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.601266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.601426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.601589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.601751 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.601913 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.602074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.602247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.602474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.602646 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.602813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.602968 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.603129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.603283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.603444 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.603607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.603761 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.603914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.604067 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.604067 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.604382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.604382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.604690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.604690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.604994 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.605155 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.605318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.605471 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.605632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.605793 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.605956 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.606116 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.606284 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.606456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.606615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.606780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.606952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.607115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.607282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.607444 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.607606 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.607759 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.607912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.608074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.608336 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.608522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.608755 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.608921 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.609075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.609254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.609415 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.609569 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.609760 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.610070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.610328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.610532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.610690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.610850 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.611013 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.611174 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.611329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.611491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.611656 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.611817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.611971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.612123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.612305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.612468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.612631 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.612785 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.612947 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.613100 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.613268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.613423 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.613600 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.613754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.613915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.614069 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.614302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.614482 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.614715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.614882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.615036 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.615189 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.615947 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.616120 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.616282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.616450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.616603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.616764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.616931 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.617085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.617248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.617416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.617572 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.617740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.617894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.618055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.618209 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.618546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.618869 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.619052 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.619217 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.619378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.619533 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.619696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.619850 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.620198 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.620464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.620633 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.620789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.620950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.621130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.621293 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.621448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.621600 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.621754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.621907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.622074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.622228 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.622381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.622571 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.622744 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.622900 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.623063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.623229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.623382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.623543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.623697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.623850 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.624012 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.624175 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.624336 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.624489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.624649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.625072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.625244 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.625398 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.625562 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.625722 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.625878 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.626039 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.626201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.626354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.626529 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.626682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.626844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.627017 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.627179 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.627340 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.627501 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.627672 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.627825 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.627993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.628147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.628308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.628577 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.628740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.628740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.629575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.629733 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.629885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.630100 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.630562 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.630751 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.630943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.631627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.631801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.631956 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.632118 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.632288 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.632451 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.632620 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.632796 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.632965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.633130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.633310 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.633473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.633635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.633789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.633952 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.634115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.634277 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.634457 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.637969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.638153 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.638329 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.638662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.638827 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.638997 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.639165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.639329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.639590 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.639765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.639920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.640082 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.640238 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.640600 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.640845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.641005 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.641238 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.641412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.641566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.641750 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.641965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.642123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.644693 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.644877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.645039 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.645213 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.645448 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.645620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.645776 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.645931 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.646177 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.646344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.646527 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.646726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.646890 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.647045 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.647209 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.647365 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.647518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.647680 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.647842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.648005 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.648169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.648337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.648491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.648701 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.648933 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.649102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.649272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.649427 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.649599 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.649836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.649997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.650159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.650324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.650573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.650995 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.651165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.651329 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.651499 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.651655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.651808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.651969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.652131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.652286 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.652452 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.652608 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.652780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.652935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.653101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.653257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.653419 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.653573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.653725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.653886 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.654040 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.654194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.654358 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.654556 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.654724 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.654879 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.655051 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.655216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.655372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.655524 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.655685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.655847 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.656001 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.656164 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.656321 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.656473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.656715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.656880 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.657034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.657211 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.657375 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.657537 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.657698 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.657851 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.658013 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.658174 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.658336 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.658542 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.658757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.658943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.659194 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.659354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.659521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.659683 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.659683 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.660117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.660282 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.661344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.661509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.661675 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.661838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.662010 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.662696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.662880 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.663049 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.663210 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.663368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.663538 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.663703 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.663858 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.664018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.664179 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.664348 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.664510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.664664 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.664664 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.664968 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.665131 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.665296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.665458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.665630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.666028 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.666191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.666352 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.666574 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.666732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.666886 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.667046 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.667208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.667373 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.667541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.667704 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.667866 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.668027 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.668191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.668355 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.668510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.668671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.668867 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.669026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.669198 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.669435 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.669605 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.669758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.669758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.670147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.670316 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.670508 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.670669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.670833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.671147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.671328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.671328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.671713 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.671884 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.672060 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.672222 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.672385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.672550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.672713 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.672926 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.673086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.673250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.673406 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.673571 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.673735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.673890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.674065 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.674229 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.674385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.674616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.674773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.674773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.675076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.675239 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.675408 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.675563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.675725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.675725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.676029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.676231 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.676400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.676400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.676711 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.676870 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.677023 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.677189 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.677346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.677510 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.677664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.677664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.678542 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.678716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.678924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.679093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.679247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.679429 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.679739 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.679909 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.680064 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.680315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.680486 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.680641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.680820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.680976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.681296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.681458 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.681703 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.681863 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.682032 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.682196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.682351 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.682540 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.682709 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.682877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.683049 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.683218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.683377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.683531 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.683686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.683801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.683892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.683892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684319 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684448 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684570 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684570 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684793 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.684907 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685034 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685283 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685510 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685638 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685875 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.685989 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.686102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.686216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.686340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.686473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.686593 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.686720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.686836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.686957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.687081 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.687203 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.687325 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.687440 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.687553 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.687666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.687799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.687921 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688401 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688638 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688884 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.688884 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.689167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.689283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.689396 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.689509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.689648 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.689841 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.689977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.690093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.690207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.690344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.690567 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.690804 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.690904 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.690987 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691068 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691684 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691772 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691854 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.691936 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692019 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692101 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692175 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692319 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692476 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692644 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692731 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.692975 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.693055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.693129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.693206 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.693279 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.693366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.693474 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.694027 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.694167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.694300 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.694440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.694580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.694706 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.694822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.694935 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.695056 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.695172 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.695295 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.695411 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.695526 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.695651 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.695775 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.695897 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696168 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696409 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696759 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696759 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.696973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.697186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.697299 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.697430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.697545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.697659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.697779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.697903 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.698025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.698149 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.698264 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.698385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.698569 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.698697 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.698818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.698942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.699101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.699230 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.699346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.699468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.699468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.699468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.699468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.700017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.700146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.700269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.700399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.700515 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.700717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.700842 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.700964 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.701078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.701200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.701316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.701592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.701725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.701842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.701966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.702089 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.702204 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.702318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.702451 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.702573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.702719 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.702837 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.702959 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.703074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.703194 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.703314 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.703506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.703624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.703757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.703960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.704082 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.704219 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.704366 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.704500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.704632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.704747 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.704860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.704984 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.705935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.706170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.706293 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.706462 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.706704 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.706868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.706994 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.707118 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.707247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.707372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.707495 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.707610 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.707736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.707858 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.707989 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.708105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.708228 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.708343 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.708457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.708644 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.708773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.708897 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.709022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.709209 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.709330 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.709456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.709582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.709705 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.709821 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.709943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.710147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.710286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.710420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.710542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.710749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.710838 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.710996 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.711077 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.711158 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.711233 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.711312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.711400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.711481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.711781 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.711877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712211 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712300 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712614 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712692 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712772 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712855 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.712931 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.713279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.713420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.713535 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.713658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.713773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.713900 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.714110 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.714237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.714354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.714523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.714657 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.714799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.714928 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715044 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715159 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715159 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715501 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715742 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.715979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.716104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.716229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.716344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.716458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.716584 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.716712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.716827 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.716948 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.717072 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.717194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.717328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.717444 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.717557 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.717670 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.717792 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.717906 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.718034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.718157 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.718272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.718385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.718548 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.718675 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.718804 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.718920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.719041 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.719156 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.719324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.719459 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.719582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.719697 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.719812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.719925 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.720038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.720179 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.720382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.720515 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.720638 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.720752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.720865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.720987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.721102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.721224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.721224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.721447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.721575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.721718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.722057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.722188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.722304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.722437 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.722573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.722573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.722819 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.722935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.723048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.723167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.723300 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.723425 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.723547 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.723670 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.723786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.723899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.724027 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.724236 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.724358 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.724358 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.724572 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.724572 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.725357 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.725479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.725593 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.725706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.725829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.725965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.726080 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.726202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.726316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.726488 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.726640 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.726785 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.726925 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.727058 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.727196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.727336 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.727545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.727681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.727812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.727951 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.728091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.728232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.728374 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.728514 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.728648 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.728779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.728918 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.729051 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.729196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.729372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.729507 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.729639 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.729780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.729930 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.730112 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.730247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.730399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.730628 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.730775 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.730922 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.731062 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.731194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.731326 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.731458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.731589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.731736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.731886 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.732226 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.732360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.732492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.732632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.732779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.732914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.733047 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.733186 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.733319 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.733461 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.733602 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:28:34.733748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.733748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:28:34.733748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:28:34.786574 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO dbcounter [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Registered counter for database nova_api Sep 01 05:28:34.789513 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO dbcounter [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Registered counter for database nova_api Sep 01 05:28:34.807834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:28:34.809249 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_db.sqlalchemy.engines [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:28:34.814538 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writer thread running {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:28:34.815710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writer thread running {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:28:34.870606 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.context [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7e5ccc8b-02a9-4328-be92-9856163a41bd(cell1) {{(pid=121030) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:28:34.871448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.context [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7e5ccc8b-02a9-4328-be92-9856163a41bd(cell1) {{(pid=121031) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 05:28:34.874535 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:34.875007 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:34.875506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:34.875969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:34.876574 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:34.877290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:34.877544 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:34.877725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:34.878266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:28:34.878738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:28:34.879741 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:34.880710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:28:34.882186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO dbcounter [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Registered counter for database nova_cell0 Sep 01 05:28:34.883199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO dbcounter [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Registered counter for database nova_cell0 Sep 01 05:28:34.886166 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO dbcounter [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Registered counter for database nova_cell1 Sep 01 05:28:34.887128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO dbcounter [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Registered counter for database nova_cell1 Sep 01 05:28:34.893307 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:28:34.895561 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:28:34.898047 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_db.sqlalchemy.engines [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:28:34.900380 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_db.sqlalchemy.engines [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:28:34.902062 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writer thread running {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:28:34.903443 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writer thread running {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:28:34.904961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writer thread running {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:28:35.043877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writer thread running {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:28:35.048513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO dbcounter [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Registered counter for database nova_cell0 Sep 01 05:28:35.054212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO dbcounter [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Registered counter for database nova_cell0 Sep 01 05:28:35.057354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:28:35.060796 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_db.sqlalchemy.engines [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:28:35.062217 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writer thread running {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:28:35.065105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writer thread running {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:28:35.382808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: WARNING keystonemiddleware.auth_token [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:28:35.386635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: WARNING keystonemiddleware.auth_token [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:28:35.390174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: WARNING keystonemiddleware.auth_token [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:28:35.394120 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: WARNING keystonemiddleware.auth_token [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:28:35.743262 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: WARNING keystonemiddleware.auth_token [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:28:35.746796 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: WARNING keystonemiddleware.auth_token [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 05:28:35.749254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: WARNING keystonemiddleware.auth_token [None req-2ea9ff79-1507-4178-80fd-525b13c5b3ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:28:35.752825 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: WARNING keystonemiddleware.auth_token [None req-e33f4015-e9a6-41dd-b9c3-35c6fc1ad592 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 05:28:35.754615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa91eb49c0 pid: 121030 (default app) Sep 01 05:28:35.758155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fa91eb49c0 pid: 121031 (default app) Sep 01 05:29:12.466877 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:12.467875 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:12.468863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:12.470111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:12.566919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:12.566919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:12.568417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:12.569875 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:13.700052 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e9507781-dda9-4d02-996c-6d1e937d03e9 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Action: 'create', calling method: .version_select at 0x7f953bfbf0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1625680964", "metadata": {"Type": "work"}}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e9507781-dda9-4d02-996c-6d1e937d03e9 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Request method failure captured: Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 122 Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEMoeadO4rbExYBpTquCQ9fn5HMpzsOpLsoV691L7SIFuxf85KuI7Hp5mrTGYNlNkFFRB3jcvIhjmRLAFq3_kIvKhaCuizHAodIxJL9tLjCdWxKy7Mrfu1JvTQ_xTd1GxJKKFMJT9M6DBthvx7gcCZycc_Xenj2DTgt8KAilbmw1rtQ Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:29:13.707867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4880508c1824fa09919255293b90906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4880508c1824fa09919255293b90906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: d357ef4db9054a32aff2daf2c5683b32 Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1625680964", "metadata": {"Type": "work"}}} Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:29:13.709592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1625680964', 'metadata': {'Type': 'work'}}}} Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:13.710914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:29:13.712581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:29:13.713990 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 05:29:13.713990 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:13.715098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e9507781-dda9-4d02-996c-6d1e937d03e9 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:13.716694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e9507781-dda9-4d02-996c-6d1e937d03e9 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.259066 Sep 01 05:29:13.717741 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 1 05:29:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1261 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:29:13.726437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7f4845a2-7755-4dd7-9386-2b14001ad4ed tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953bfbfdc0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:13.838498 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-06abf129-6333-4180-ae61-3bae32af9cd8 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Action: 'create', calling method: .version_select at 0x7f953bfbd160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-992053856", "metadata": {"Type": "work"}}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:14.243261 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7f4845a2-7755-4dd7-9386-2b14001ad4ed tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/8a552cd7-7141-4624-b1c1-26d4ab6a90a0" status: 200 len: 350 microversion: 2.1 time: 0.523539 Sep 01 05:29:14.244472 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 2/2] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:13 2022] GET /compute/v2.1/os-volumes/8a552cd7-7141-4624-b1c1-26d4ab6a90a0 => generated 350 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:14.249753 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-10916d01-b6bc-40eb-85cf-85e8951bac29 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Action: 'create', calling method: .version_select at 0x7f953be504c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303447900", "metadata": {"Type": "work"}}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-10916d01-b6bc-40eb-85cf-85e8951bac29 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Request method failure captured: Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 119 Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEMoeadO4rbExYBpTquCQ9fn5HMpzsOpLsoV691L7SIFuxf85KuI7Hp5mrTGYNlNkFFRB3jcvIhjmRLAFq3_kIvKhaCuizHAodIxJL9tLjCdWxKy7Mrfu1JvTQ_xTd1GxJKKFMJT9M6DBthvx7gcCZycc_Xenj2DTgt8KAilbmw1rtQ Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:29:14.263817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4880508c1824fa09919255293b90906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4880508c1824fa09919255293b90906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: d357ef4db9054a32aff2daf2c5683b32 Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-303447900", "metadata": {"Type": "work"}}} Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:29:14.265317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-303447900', 'metadata': {'Type': 'work'}}}} Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi '0' Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:14.266227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:29:14.267878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:29:14.269736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 05:29:14.269736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.277002 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-10916d01-b6bc-40eb-85cf-85e8951bac29 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:14.285799 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-10916d01-b6bc-40eb-85cf-85e8951bac29 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.033556 Sep 01 05:29:14.285799 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 3/3] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 1 05:29:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:29:14.297774 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4f6c565a-05e5-4faf-b403-daf196118644 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Action: 'create', calling method: .version_select at 0x7f953be5c8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1521155478", "metadata": {"Type": "work"}}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4f6c565a-05e5-4faf-b403-daf196118644 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Request method failure captured: Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 119 Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEMoeadO4rbExYBpTquCQ9fn5HMpzsOpLsoV691L7SIFuxf85KuI7Hp5mrTGYNlNkFFRB3jcvIhjmRLAFq3_kIvKhaCuizHAodIxJL9tLjCdWxKy7Mrfu1JvTQ_xTd1GxJKKFMJT9M6DBthvx7gcCZycc_Xenj2DTgt8KAilbmw1rtQ Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:29:14.309562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4880508c1824fa09919255293b90906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4880508c1824fa09919255293b90906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: d357ef4db9054a32aff2daf2c5683b32 Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1521155478", "metadata": {"Type": "work"}}} Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:29:14.311076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1521155478', 'metadata': {'Type': 'work'}}}} Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise error Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi '' Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:14.311912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 05:29:14.313384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 05:29:14.314671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 05:29:14.314671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:14.314671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4f6c565a-05e5-4faf-b403-daf196118644 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:14.314671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4f6c565a-05e5-4faf-b403-daf196118644 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023888 Sep 01 05:29:14.314671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 4/4] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 1 05:29:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:29:14.322986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3b1206a7-864f-4663-b2e9-cb40c238a5ed tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Calling method '.version_select at 0x7f953bfbf550>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-3b1206a7-864f-4663-b2e9-cb40c238a5ed tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] HTTP exception thrown: Volume tempest-invalid-1681824706 could not be found. Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3b1206a7-864f-4663-b2e9-cb40c238a5ed tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Request method failure captured: Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1681824706 HTTP/1.1 Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEMoeadO4rbExYBpTquCQ9fn5HMpzsOpLsoV691L7SIFuxf85KuI7Hp5mrTGYNlNkFFRB3jcvIhjmRLAFq3_kIvKhaCuizHAodIxJL9tLjCdWxKy7Mrfu1JvTQ_xTd1GxJKKFMJT9M6DBthvx7gcCZycc_Xenj2DTgt8KAilbmw1rtQ Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:29:15.712370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4880508c1824fa09919255293b90906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4880508c1824fa09919255293b90906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: d357ef4db9054a32aff2daf2c5683b32 Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Volume tempest-invalid-1681824706 could not be found. Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': 'tempest-invalid-1681824706'} Sep 01 05:29:15.719575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1681824706 could not be found. (HTTP 404) (Request-ID: req-25f44b56-9b5b-4542-91eb-d87698ff9bde) Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.721475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:29:15.723195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1681824706 could not be found. Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:29:15.724942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1681824706 could not be found. Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1681824706 could not be found. Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3b1206a7-864f-4663-b2e9-cb40c238a5ed tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Returning 404 to user: Volume tempest-invalid-1681824706 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3b1206a7-864f-4663-b2e9-cb40c238a5ed tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1681824706" status: 404 len: 99 microversion: 2.1 time: 1.086543 Sep 01 05:29:15.726580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 5/5] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 1 05:29:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1681824706 => generated 99 bytes in 1088 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 01 05:29:15.732370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-77761e07-382f-408b-bd69-944ddab17b5e tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008526 Sep 01 05:29:15.732370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 6/6] 10.222.0.16 () {58 vars in 1140 bytes} [Thu Sep 1 05:29:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:29:15.732370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2618c62f-b163-47f5-8214-4d689b959a29 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018286 Sep 01 05:29:15.732370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 7/7] 10.222.0.16 () {58 vars in 1137 bytes} [Thu Sep 1 05:29:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 05:29:15.732370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5ebd688a-0a08-405b-b332-b2f9988bfb89 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Calling method '.version_select at 0x7f953c7fd430>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:15.733293 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-06abf129-6333-4180-ae61-3bae32af9cd8 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.144141 Sep 01 05:29:15.733293 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 1/8] 10.222.0.16 () {60 vars in 1156 bytes} [Thu Sep 1 05:29:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3147 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 05:29:15.733293 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9bb3fc0b-f14b-4080-a368-7979819d255e tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Calling method '.version_select at 0x7f953bea0040>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:15.738492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-5ebd688a-0a08-405b-b332-b2f9988bfb89 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] HTTP exception thrown: Volume fdf2646f-cf9b-4f63-a481-b666d82418d8 could not be found. Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5ebd688a-0a08-405b-b332-b2f9988bfb89 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Request method failure captured: Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: DELETE /compute/v2.1/os-volumes/fdf2646f-cf9b-4f63-a481-b666d82418d8 HTTP/1.1 Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEMoeadO4rbExYBpTquCQ9fn5HMpzsOpLsoV691L7SIFuxf85KuI7Hp5mrTGYNlNkFFRB3jcvIhjmRLAFq3_kIvKhaCuizHAodIxJL9tLjCdWxKy7Mrfu1JvTQ_xTd1GxJKKFMJT9M6DBthvx7gcCZycc_Xenj2DTgt8KAilbmw1rtQ Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:29:15.740005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4880508c1824fa09919255293b90906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4880508c1824fa09919255293b90906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: d357ef4db9054a32aff2daf2c5683b32 Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Volume fdf2646f-cf9b-4f63-a481-b666d82418d8 could not be found. Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': 'fdf2646f-cf9b-4f63-a481-b666d82418d8'} Sep 01 05:29:15.740977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fdf2646f-cf9b-4f63-a481-b666d82418d8 could not be found. (HTTP 404) (Request-ID: req-79f86dba-696e-4eeb-af76-5bb10f79bbaf) Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.741695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:29:15.746715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fdf2646f-cf9b-4f63-a481-b666d82418d8 could not be found. Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:29:15.747635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fdf2646f-cf9b-4f63-a481-b666d82418d8 could not be found. Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fdf2646f-cf9b-4f63-a481-b666d82418d8 could not be found. Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5ebd688a-0a08-405b-b332-b2f9988bfb89 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Returning 404 to user: Volume fdf2646f-cf9b-4f63-a481-b666d82418d8 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5ebd688a-0a08-405b-b332-b2f9988bfb89 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/fdf2646f-cf9b-4f63-a481-b666d82418d8" status: 404 len: 109 microversion: 2.1 time: 0.276663 Sep 01 05:29:15.748669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 8/9] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:29:15 2022] DELETE /compute/v2.1/os-volumes/fdf2646f-cf9b-4f63-a481-b666d82418d8 => generated 109 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:29:15.752348 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-86b5b2e5-7fa7-4033-b1fe-fb007ce7b265 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Calling method '.version_select at 0x7f953be5ca60>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:15.882534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9bb3fc0b-f14b-4080-a368-7979819d255e tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a" status: 200 len: 352 microversion: 2.1 time: 0.178583 Sep 01 05:29:15.883431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 2/10] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:15 2022] GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a => generated 352 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:15.895404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-86b5b2e5-7fa7-4033-b1fe-fb007ce7b265 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] HTTP exception thrown: Volume ea35b853-538b-45ac-b4cc-428e86c4c5e4 could not be found. Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-86b5b2e5-7fa7-4033-b1fe-fb007ce7b265 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Request method failure captured: Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/os-volumes/ea35b853-538b-45ac-b4cc-428e86c4c5e4 HTTP/1.1 Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEMoeadO4rbExYBpTquCQ9fn5HMpzsOpLsoV691L7SIFuxf85KuI7Hp5mrTGYNlNkFFRB3jcvIhjmRLAFq3_kIvKhaCuizHAodIxJL9tLjCdWxKy7Mrfu1JvTQ_xTd1GxJKKFMJT9M6DBthvx7gcCZycc_Xenj2DTgt8KAilbmw1rtQ Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:29:15.897502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a4880508c1824fa09919255293b90906"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a4880508c1824fa09919255293b90906"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a4880508c1824fa09919255293b90906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: a4880508c1824fa09919255293b90906 Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesNegativeTest-1167470822 Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: d357ef4db9054a32aff2daf2c5683b32 Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesNegativeTest-1167470822-project Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Volume ea35b853-538b-45ac-b4cc-428e86c4c5e4 could not be found. Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': 'ea35b853-538b-45ac-b4cc-428e86c4c5e4'} Sep 01 05:29:15.898566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea35b853-538b-45ac-b4cc-428e86c4c5e4 could not be found. (HTTP 404) (Request-ID: req-08860b11-2d41-46eb-aca2-1780093f437a) Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.899186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:29:15.900505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea35b853-538b-45ac-b4cc-428e86c4c5e4 could not be found. Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:29:15.901358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea35b853-538b-45ac-b4cc-428e86c4c5e4 could not be found. Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea35b853-538b-45ac-b4cc-428e86c4c5e4 could not be found. Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-86b5b2e5-7fa7-4033-b1fe-fb007ce7b265 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] Returning 404 to user: Volume ea35b853-538b-45ac-b4cc-428e86c4c5e4 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-86b5b2e5-7fa7-4033-b1fe-fb007ce7b265 tempest-VolumesNegativeTest-1167470822 tempest-VolumesNegativeTest-1167470822-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ea35b853-538b-45ac-b4cc-428e86c4c5e4" status: 404 len: 109 microversion: 2.1 time: 0.151586 Sep 01 05:29:15.902296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 9/11] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:15 2022] GET /compute/v2.1/os-volumes/ea35b853-538b-45ac-b4cc-428e86c4c5e4 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:29:16.897125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aded3ed5-52d1-4ae2-923c-0138eeeb2df0 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Calling method '.version_select at 0x7f953bea0700>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:16.937152 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-944a9c21-c260-4e5d-9ca9-145f3653adf7 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953be504c0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:17.017511 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aded3ed5-52d1-4ae2-923c-0138eeeb2df0 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a" status: 200 len: 353 microversion: 2.1 time: 0.125072 Sep 01 05:29:17.018241 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 3/12] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:16 2022] GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:17.033554 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8a96befa-fc03-425d-9d6d-c481878b4728 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Calling method '.version_select at 0x7f953bea0dc0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:17.038276 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-944a9c21-c260-4e5d-9ca9-145f3653adf7 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b17743cc-53fc-4030-9335-99af3354ee7c" status: 200 len: 351 microversion: 2.1 time: 0.104836 Sep 01 05:29:17.038872 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 10/13] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:16 2022] GET /compute/v2.1/os-volumes/b17743cc-53fc-4030-9335-99af3354ee7c => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:29:17.166591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8a96befa-fc03-425d-9d6d-c481878b4728 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a" status: 200 len: 353 microversion: 2.1 time: 0.136790 Sep 01 05:29:17.167604 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 4/14] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:17 2022] GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:29:17.186295 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fa6b3c24-803d-4a3c-b107-23436ab64203 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Calling method '.version_select at 0x7f953bfbfdc0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:17.480376 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fa6b3c24-803d-4a3c-b107-23436ab64203 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a" status: 202 len: 0 microversion: 2.1 time: 0.297965 Sep 01 05:29:17.483320 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 11/15] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:29:17 2022] DELETE /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:29:17.491730 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b93cf21f-8c02-4ce8-b8a6-a85161b9d0f0 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Calling method '.version_select at 0x7f953bea0b80>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:17.804624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b93cf21f-8c02-4ce8-b8a6-a85161b9d0f0 tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a" status: 200 len: 352 microversion: 2.1 time: 0.317595 Sep 01 05:29:17.805852 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 5/16] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:17 2022] GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a => generated 352 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:18.827621 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9c53baa6-fcc0-4e55-a5e0-857b4890bd9c tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Calling method '.version_select at 0x7f953be5c160>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-9c53baa6-fcc0-4e55-a5e0-857b4890bd9c tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] HTTP exception thrown: Volume 5dde93fa-187d-4536-9479-1974ceccbd7a could not be found. Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9c53baa6-fcc0-4e55-a5e0-857b4890bd9c tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Request method failure captured: Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a HTTP/1.1 Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEMoI82neiwaIAdDS2sVWc0kny_3kLWwB62BQ3p9t_cMcZ_SVvmJQXdh7zaDcC2XFBoiiu8PUfCXbdJMrnmA4FchSeq56p7GIENJ8nvHqh0wVJKf__oOWdMB85LQfjA7o-jhgj5eCF8iEqtmJ3t0nGFqB9ENkhfapiDoSdYR4f2DHp0 Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 1c2ad5de95314180a9a4cf16c82bbe27 Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesGetTestJSON-777673446 Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:29:18.897957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1c2ad5de95314180a9a4cf16c82bbe27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c2ad5de95314180a9a4cf16c82bbe27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1c2ad5de95314180a9a4cf16c82bbe27"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1c2ad5de95314180a9a4cf16c82bbe27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesGetTestJSON-777673446 Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 1c2ad5de95314180a9a4cf16c82bbe27 Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesGetTestJSON-777673446 Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesGetTestJSON-777673446-project Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: b69e39bc10c54335aa301ce2e98d8505 Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesGetTestJSON-777673446-project Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Volume 5dde93fa-187d-4536-9479-1974ceccbd7a could not be found. Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '5dde93fa-187d-4536-9479-1974ceccbd7a'} Sep 01 05:29:18.899354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5dde93fa-187d-4536-9479-1974ceccbd7a could not be found. (HTTP 404) (Request-ID: req-982d32d9-3ca5-4c06-82e9-5daa42326708) Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:18.900076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:29:18.900958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5dde93fa-187d-4536-9479-1974ceccbd7a could not be found. Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:29:18.902913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5dde93fa-187d-4536-9479-1974ceccbd7a could not be found. Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5dde93fa-187d-4536-9479-1974ceccbd7a could not be found. Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9c53baa6-fcc0-4e55-a5e0-857b4890bd9c tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] Returning 404 to user: Volume 5dde93fa-187d-4536-9479-1974ceccbd7a could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9c53baa6-fcc0-4e55-a5e0-857b4890bd9c tempest-VolumesGetTestJSON-777673446 tempest-VolumesGetTestJSON-777673446-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a" status: 404 len: 109 microversion: 2.1 time: 0.077316 Sep 01 05:29:18.904681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 12/17] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:18 2022] GET /compute/v2.1/os-volumes/5dde93fa-187d-4536-9479-1974ceccbd7a => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:29:19.433561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-57cf4a82-30f3-4a61-892f-073a2ebeddef tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953bea04c0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:19.537907 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-57cf4a82-30f3-4a61-892f-073a2ebeddef tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/5491f582-e36c-442a-bc4a-598a47117523" status: 200 len: 351 microversion: 2.1 time: 0.111623 Sep 01 05:29:19.538781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 6/18] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:29:19 2022] GET /compute/v2.1/os-volumes/5491f582-e36c-442a-bc4a-598a47117523 => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:19.553252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3fed38c8-1368-4c52-aa91-0904c9301895 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953be50d30>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:19.755015 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3fed38c8-1368-4c52-aa91-0904c9301895 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.206231 Sep 01 05:29:19.755582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 13/19] 10.222.0.16 () {58 vars in 1134 bytes} [Thu Sep 1 05:29:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:19.770721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7e582702-b3c6-46fc-aa7d-964e684e08bd tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953be8aee0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:19.950165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7e582702-b3c6-46fc-aa7d-964e684e08bd tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.183795 Sep 01 05:29:19.951066 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 7/20] 10.222.0.16 () {58 vars in 1149 bytes} [Thu Sep 1 05:29:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:19.965123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-320c317c-1b21-4ba0-93a6-296b2480c607 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953be5caf0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:20.135879 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-320c317c-1b21-4ba0-93a6-296b2480c607 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.174841 Sep 01 05:29:20.137074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 14/21] 10.222.0.16 () {58 vars in 1134 bytes} [Thu Sep 1 05:29:19 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:20.150357 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cdea1a96-939c-4249-aa8b-8c40ba6e72d7 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953bfbdee0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:20.328860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cdea1a96-939c-4249-aa8b-8c40ba6e72d7 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.182772 Sep 01 05:29:20.329603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 8/22] 10.222.0.16 () {58 vars in 1167 bytes} [Thu Sep 1 05:29:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:20.346976 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dc4da8f9-a54e-4b98-b3db-fe862bdd4334 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953be50790>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:20.510918 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-dc4da8f9-a54e-4b98-b3db-fe862bdd4334 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.167555 Sep 01 05:29:20.511421 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 15/23] 10.222.0.16 () {58 vars in 1170 bytes} [Thu Sep 1 05:29:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:20.527580 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6964c951-4fe7-4b7d-8090-ba2fbfb02c75 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953be2d160>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:20.724130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6964c951-4fe7-4b7d-8090-ba2fbfb02c75 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.201873 Sep 01 05:29:20.726104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 9/24] 10.222.0.16 () {58 vars in 1155 bytes} [Thu Sep 1 05:29:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:20.739716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6d17f62e-0765-4677-adfa-7535408edfa3 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953be5b790>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:20.886650 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6d17f62e-0765-4677-adfa-7535408edfa3 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.151506 Sep 01 05:29:20.902509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 16/25] 10.222.0.16 () {58 vars in 1188 bytes} [Thu Sep 1 05:29:20 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:20.904628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-127cd00a-b964-4b43-859c-d661181e3510 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] Calling method '.version_select at 0x7f953be323a0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:21.082369 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-127cd00a-b964-4b43-859c-d661181e3510 tempest-VolumesTestJSON-1070610106 tempest-VolumesTestJSON-1070610106-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.181833 Sep 01 05:29:21.101089 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 10/26] 10.222.0.16 () {58 vars in 1155 bytes} [Thu Sep 1 05:29:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:23.266459 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-500516031", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "networks": [{"uuid": "eb799e87-5a32-46f6-85ae-eaeb95d15284"}]}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:23.506061 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] validate_networks() for [('eb799e87-5a32-46f6-85ae-eaeb95d15284', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:29:26.277266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:29:26.277854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:29:26.278144 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:29:26.279457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:29:26.279943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:29:26.310062 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:26.314122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:26.317826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:26.318813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:26.319561 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:26.322732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:26.397671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Getting quotas for project cc23f8d119514ad595637967b626e87d. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:29:26.414666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Getting quotas for user 55c9d3a3577746a4ad7406fe4396eaee and project cc23f8d119514ad595637967b626e87d. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:29:26.445981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:29:26.453449 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:29:26.735204 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-bffb52a6-7bca-4f79-b479-b477b523c642 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.983007 Sep 01 05:29:26.737961 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 17/27] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:29:26.748864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ddcc470b-3fea-4193-86d3-4a8c9a332855 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:26.756434 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ddcc470b-3fea-4193-86d3-4a8c9a332855 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:27.192082 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ddcc470b-3fea-4193-86d3-4a8c9a332855 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:27.233069 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ddcc470b-3fea-4193-86d3-4a8c9a332855 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1214 microversion: 2.1 time: 0.488656 Sep 01 05:29:27.242804 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 11/28] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:26 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1214 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:28.259405 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c9472e1b-e980-4df6-a2ec-b6a6edf05990 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:28.260190 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c9472e1b-e980-4df6-a2ec-b6a6edf05990 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:28.627764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c9472e1b-e980-4df6-a2ec-b6a6edf05990 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:28.670934 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c9472e1b-e980-4df6-a2ec-b6a6edf05990 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1214 microversion: 2.1 time: 0.413579 Sep 01 05:29:28.675134 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 18/29] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:28 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1214 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:29.358372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c9a729be-6e5f-47bc-a649-33ba4d335979 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'create', calling method: .version_select at 0x7f953be2d550>, body: {"keypair": {"name": "tempest-keypair-954225171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPllVGn+NxUd7vGpZaABtvuqq6r0FV3NaEBxmdDgAfpKfRHyssz4N9jYU3WEgXtFcjqAzFsO9QZJrt4YutNC3TV5q/LkQg+3rcjJ67jpDWQY5cAynvq4fHVpncmwtVLYpg=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:29.485969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-c9a729be-6e5f-47bc-a649-33ba4d335979 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Getting quotas for project 538589fdc80248a3a3e82802151b4eb6. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:29:29.499116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-c9a729be-6e5f-47bc-a649-33ba4d335979 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Getting quotas for user f661527186794ba296b322c22a78f3f0 and project 538589fdc80248a3a3e82802151b4eb6. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:29:29.697403 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a2a6acbd-8a83-4e11-81ff-36c3beb6ac06 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:29.698514 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a2a6acbd-8a83-4e11-81ff-36c3beb6ac06 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:29.715566 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c9a729be-6e5f-47bc-a649-33ba4d335979 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.610833 Sep 01 05:29:29.723757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 12/30] 10.222.0.16 () {62 vars in 1200 bytes} [Thu Sep 1 05:29:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 612 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:29:29.839171 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a2a6acbd-8a83-4e11-81ff-36c3beb6ac06 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:29.862228 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a2a6acbd-8a83-4e11-81ff-36c3beb6ac06 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1214 microversion: 2.1 time: 0.163570 Sep 01 05:29:29.864489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 19/31] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:29 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:30.891382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:30.896911 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:30.916202 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:30.918013 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:30.943180 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:30.943940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:30.944404 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:30.959518 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:31.611061 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:31.663104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ff82d73b-612a-4614-a2bd-a55f00c7a92e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1210 microversion: 2.1 time: 0.759909 Sep 01 05:29:31.668024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 13/32] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:30 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1210 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:32.007352 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-386971765", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:32.099207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] validate_networks() for [('d22d36b6-30d8-42bc-8d1d-e8136d4e46da', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:29:32.694379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:32.694379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:32.704480 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:32.704961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:32.705425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:32.706181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:32.706652 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:32.711001 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:32.965018 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:32.974136 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4ef7395c-1dc2-4562-9c22-263a35878761 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1274 microversion: 2.1 time: 0.286232 Sep 01 05:29:32.979471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 14/33] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:32 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:33.023591 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:29:33.024052 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:29:33.024480 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:29:33.024933 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:29:33.025356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:29:33.071705 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:33.073877 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:33.074343 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:33.075162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:33.079813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:33.082745 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:33.192602 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Getting quotas for project b34f5b5ce7c44930b3c85701d9ceb384. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:29:33.224174 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Getting quotas for user f4a01fadccd941fc98ecc99dac4e25c4 and project b34f5b5ce7c44930b3c85701d9ceb384. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:29:33.260230 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:29:33.267818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:29:33.545525 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8206e295-9bcd-4260-9872-7b136737d32c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.802857 Sep 01 05:29:33.557681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 20/34] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:29:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:29:33.559947 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-12ef9810-d5ce-4679-bf16-28d9b7601d1a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:33.565145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-12ef9810-d5ce-4679-bf16-28d9b7601d1a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:33.693078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-12ef9810-d5ce-4679-bf16-28d9b7601d1a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:33.702672 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-12ef9810-d5ce-4679-bf16-28d9b7601d1a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1221 microversion: 2.1 time: 0.146744 Sep 01 05:29:33.703945 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 15/35] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:33 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:34.002361 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:34.003366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:34.017012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:34.018433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:34.019721 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:34.020711 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1326130803", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:34.025821 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:34.026601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:34.027579 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:34.273719 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] validate_networks() for [('d22d36b6-30d8-42bc-8d1d-e8136d4e46da', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:29:34.373186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:34.393823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-57b2d46e-0b49-48e6-a514-80dfe49d8e08 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1272 microversion: 2.1 time: 0.396360 Sep 01 05:29:34.399232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 21/36] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:33 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1272 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:35.444499 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c2c62950-8466-4451-a0da-82b0c11ab8d5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: .version_select at 0x7f953b4e2e50>, body: {"keypair": {"name": "tempest-keypair-1905730792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSsghv8T0vZyLcmEZ0EZhpmlxJzJxQuDmD9qU1IgEhaqRzf2PWe+JpPYaT4GGxA3z5IOcqOu3QpdkUxwI4GwNT+ikgxyDLRih6vq9TjrJwKy5y2ZG2DDaFLn8ETctfsGg=="}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:35.468617 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-c2c62950-8466-4451-a0da-82b0c11ab8d5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for project 1a200065c13e42babe6353689aabd896. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:29:35.473122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-c2c62950-8466-4451-a0da-82b0c11ab8d5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for user 11770fbaeacd4fc7bc4052e83630dbb3 and project 1a200065c13e42babe6353689aabd896. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:29:35.539143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:29:35.539654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:29:35.540020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:29:35.540418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:29:35.542328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:29:35.552171 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:35.552643 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:35.553074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:35.553779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:35.554218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:35.554660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:35.578093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Getting quotas for project b34f5b5ce7c44930b3c85701d9ceb384. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:29:35.583314 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Getting quotas for user f4a01fadccd941fc98ecc99dac4e25c4 and project b34f5b5ce7c44930b3c85701d9ceb384. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:29:35.595685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:29:35.598687 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:29:36.148729 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c2c62950-8466-4451-a0da-82b0c11ab8d5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.917244 Sep 01 05:29:36.148729 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 22/37] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:29:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:36.162579 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:36.165200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:36.181127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:36.181848 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:36.183877 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:36.185540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:36.186179 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:36.186798 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:36.218180 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b819b1f3-1252-4c65-97fa-ef3ac040b7d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.203475 Sep 01 05:29:36.224230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 16/38] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:29:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:29:36.256755 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-98e03e07-93e4-4230-b3a2-a34a7dcf49a0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:36.258812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-98e03e07-93e4-4230-b3a2-a34a7dcf49a0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:36.690194 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-98e03e07-93e4-4230-b3a2-a34a7dcf49a0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:36.699117 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:36.711874 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8da0bdf4-aa8f-4af3-89fe-c3ded18419e4 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1272 microversion: 2.1 time: 0.561232 Sep 01 05:29:36.715964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-98e03e07-93e4-4230-b3a2-a34a7dcf49a0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1222 microversion: 2.1 time: 0.484926 Sep 01 05:29:36.720458 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 17/39] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:36 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1222 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:36.720944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 23/40] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:36 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1272 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:37.744372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-317c6cb5-c81c-4bd3-b119-f614dd7811ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:37.744995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-317c6cb5-c81c-4bd3-b119-f614dd7811ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:37.749104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:37.749104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:37.766097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:37.766645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:37.775390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:37.778825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:37.783583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:37.783583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:37.872435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-317c6cb5-c81c-4bd3-b119-f614dd7811ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:37.894911 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-317c6cb5-c81c-4bd3-b119-f614dd7811ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1222 microversion: 2.1 time: 0.143358 Sep 01 05:29:37.906706 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 18/41] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:37 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:38.306056 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:38.316451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-01bdd2c8-f017-4d1a-ae38-d37dc700f6ab tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.581037 Sep 01 05:29:38.324570 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 24/42] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:37 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:38.866930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1147378321", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4be59972-fc0c-442c-aca3-658b1a92211f"}], "security_groups": [{"name": "tempest-securitygroup--1720311587"}], "key_name": "tempest-keypair-954225171", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:38.920421 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:38.921184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:38.933930 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:38.939108 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:38.939797 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:38.942699 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:38.945805 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:38.950962 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:39.288060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] validate_networks() for [('4be59972-fc0c-442c-aca3-658b1a92211f', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:29:39.343469 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:39.356171 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7380a323-cc52-42fd-93f2-43cfb4ceb70a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1218 microversion: 2.1 time: 0.439511 Sep 01 05:29:39.375786 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 25/43] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:38 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1218 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:39.381945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:39.382996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:39.389625 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:39.390625 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:39.391221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:39.392247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:39.393355 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:39.394509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:40.104624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:40.130716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-902df208-a4a4-42e4-89c4-5dfa9facc920 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.752034 Sep 01 05:29:40.132495 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 26/44] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:39 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:40.393369 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:40.394147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:40.425062 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:40.425561 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:40.435706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:40.440041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:40.440549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:40.440995 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:40.960590 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:40.988451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c0f4154a-d150-4f95-9a81-4f8b7a55f2d2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1274 microversion: 2.1 time: 0.608052 Sep 01 05:29:40.989649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 27/45] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:40 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1274 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:41.159632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:41.162583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:41.185203 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:41.185725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:41.186166 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:41.186907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:41.187360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:41.187789 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:41.351966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:29:41.360856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:29:41.360856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:29:41.360856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:29:41.360856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:29:41.382559 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:41.383105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:41.383580 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:41.384337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:41.403933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:41.404477 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:41.525686 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Getting quotas for project 538589fdc80248a3a3e82802151b4eb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:29:41.540211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Getting quotas for user f661527186794ba296b322c22a78f3f0 and project 538589fdc80248a3a3e82802151b4eb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:29:41.615989 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:29:41.618203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:29:41.775255 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:41.788255 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5d8a6f02-3e1f-404e-8900-8b659efab414 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.633149 Sep 01 05:29:41.794433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 28/46] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:41 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:41.872831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-326b27a3-c8c2-482b-8026-896436e49f28 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.011310 Sep 01 05:29:41.877392 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 19/47] 10.222.0.16 () {62 vars in 1188 bytes} [Thu Sep 1 05:29:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 3017 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:29:41.885569 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3ad09c86-560f-46e7-857b-9372bb3a7500 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:41.887461 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3ad09c86-560f-46e7-857b-9372bb3a7500 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:42.012433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:42.013184 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:42.031924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:42.040242 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:42.041014 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:42.043322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:42.045633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:42.049632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:42.321534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:42.336347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-db97292d-5ceb-44c4-9932-906e0203bd36 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1280 microversion: 2.1 time: 0.325219 Sep 01 05:29:42.339631 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 20/48] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:42 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1280 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:42.431279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3ad09c86-560f-46e7-857b-9372bb3a7500 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:42.440710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3ad09c86-560f-46e7-857b-9372bb3a7500 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:42.442178 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3ad09c86-560f-46e7-857b-9372bb3a7500 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:42.449274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3ad09c86-560f-46e7-857b-9372bb3a7500 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1281 microversion: 2.20 time: 0.568312 Sep 01 05:29:42.450372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 29/49] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:41 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1281 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:42.815002 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:42.815625 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:42.831967 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:42.832710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:42.834473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:42.838948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:42.839721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:42.841093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:43.051097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-44e0be60-9b86-46fa-84aa-8ad5ab327d6b req-50d9f80d-a266-4fb3-995d-2f50e402ee48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335b0b3d-5511-4399-b007-7431ea003409", "tag": "0fac7473-6d8d-45ab-adf4-22c2f3a04dd7"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:43.051097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-44e0be60-9b86-46fa-84aa-8ad5ab327d6b req-50d9f80d-a266-4fb3-995d-2f50e402ee48 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:43.051097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-44e0be60-9b86-46fa-84aa-8ad5ab327d6b req-50d9f80d-a266-4fb3-995d-2f50e402ee48 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:43.051097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-44e0be60-9b86-46fa-84aa-8ad5ab327d6b req-50d9f80d-a266-4fb3-995d-2f50e402ee48 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:43.109582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-44e0be60-9b86-46fa-84aa-8ad5ab327d6b req-50d9f80d-a266-4fb3-995d-2f50e402ee48 service nova] Creating event network-changed:0fac7473-6d8d-45ab-adf4-22c2f3a04dd7 for instance 335b0b3d-5511-4399-b007-7431ea003409 on hv-cinder-83602 Sep 01 05:29:43.111657 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-44e0be60-9b86-46fa-84aa-8ad5ab327d6b req-50d9f80d-a266-4fb3-995d-2f50e402ee48 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 05:29:43.112212 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-44e0be60-9b86-46fa-84aa-8ad5ab327d6b req-50d9f80d-a266-4fb3-995d-2f50e402ee48 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 05:29:43.115714 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4377add7-af36-4e50-9925-77eb35166682 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:43.116673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4377add7-af36-4e50-9925-77eb35166682 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:43.117250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:43.117491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4377add7-af36-4e50-9925-77eb35166682 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:43.118520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4377add7-af36-4e50-9925-77eb35166682 None None] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:43.119170 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4377add7-af36-4e50-9925-77eb35166682 None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:43.119847 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4377add7-af36-4e50-9925-77eb35166682 None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:43.128107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-af5469f0-34d5-4c15-926f-ea81a398761b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.316468 Sep 01 05:29:43.131860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 21/50] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:42 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:43.157139 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=4 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:43.165373 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.compute.rpcapi [None req-4377add7-af36-4e50-9925-77eb35166682 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 05:29:43.166322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4377add7-af36-4e50-9925-77eb35166682 None None] Releasing lock "compute-rpcapi-router" {{(pid=121030) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 05:29:43.218472 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4377add7-af36-4e50-9925-77eb35166682 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355419 Sep 01 05:29:43.222398 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 30/51] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:43.360440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:43.361503 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:43.372932 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:43.375476 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:43.376342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:43.379204 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:43.379945 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:43.381795 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:43.479416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-646bac80-80d7-4f17-b7e4-4c35c6b35fb2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:43.482490 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-646bac80-80d7-4f17-b7e4-4c35c6b35fb2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:43.647539 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-646bac80-80d7-4f17-b7e4-4c35c6b35fb2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:43.657981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-646bac80-80d7-4f17-b7e4-4c35c6b35fb2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:43.661734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-646bac80-80d7-4f17-b7e4-4c35c6b35fb2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:43.667162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-646bac80-80d7-4f17-b7e4-4c35c6b35fb2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1281 microversion: 2.20 time: 0.194212 Sep 01 05:29:43.668283 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 31/52] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:43 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:29:43.920168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:43.929710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-023a8c1d-136e-44b1-bac1-4e849dc59410 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1280 microversion: 2.1 time: 0.573600 Sep 01 05:29:43.944410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 22/53] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:43 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1280 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:44.153722 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:44.154369 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:44.161889 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:44.163055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:44.163491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:44.164176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:44.164620 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:44.165031 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:44.559769 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:44.570369 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-291bada8-a5f0-4e03-b99d-2506a506edf8 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.420715 Sep 01 05:29:44.571195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 32/54] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:44 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:44.698697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:44.699342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:44.713873 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:44.719286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:44.719286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:44.719286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:44.719286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:44.720064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:44.811891 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:44.822748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:44.824336 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:44.825470 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c256d4a1-4ca2-46b5-ba6b-3af2d85fb395 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1285 microversion: 2.20 time: 0.138888 Sep 01 05:29:44.826503 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 23/55] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:44 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:44.959701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:44.960301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:44.966978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:44.967947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:44.968694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:44.977930 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:44.978494 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:44.979093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:45.142345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:45.151017 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f8013500-6d71-4e4c-9c09-22f79bb1b95d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.195003 Sep 01 05:29:45.162498 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 33/56] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:44 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:45.357138 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1666139916", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00c5deda-d635-4d45-9035-2f4ba75e32f9"}], "security_groups": [{"name": "tempest-securitygroup--1698580206"}], "key_name": "tempest-keypair-1905730792", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:45.596172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:45.597453 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:45.615493 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:45.616091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:45.616586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:45.617298 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:45.622523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:45.622523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:45.721877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] validate_networks() for [('00c5deda-d635-4d45-9035-2f4ba75e32f9', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:29:45.998615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:46.011279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-57a54c52-0de1-4e07-92be-7508b349c255 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.417091 Sep 01 05:29:46.012786 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 34/57] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:45 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:46.029418 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:46.031040 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:46.038542 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:46.040127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:46.040127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:46.052290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:46.053351 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:46.053940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:46.194350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:46.222818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:46.222818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:46.222818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4e79d4f8-af77-44be-899a-7a9f91ef8973 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1285 microversion: 2.20 time: 0.192717 Sep 01 05:29:46.223102 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 35/58] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:46 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:46.223102 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:46.223102 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:46.240079 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:46.240079 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:46.240405 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:46.241095 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:46.250699 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:46.251404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:46.384438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:29:46.385278 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:29:46.385890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:29:46.386416 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:29:46.386940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:29:46.408579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:46.409290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:46.409868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:46.410776 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:46.411941 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:46.424800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:46.504745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for project 1a200065c13e42babe6353689aabd896. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:29:46.522922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for user 11770fbaeacd4fc7bc4052e83630dbb3 and project 1a200065c13e42babe6353689aabd896. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:29:46.557344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:29:46.559868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:29:46.780545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-40513da5-95b5-4798-9232-de4cf0943177 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.411551 Sep 01 05:29:46.781909 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 24/59] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:29:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:29:46.800042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c9f6d23a-22bf-4811-83c8-30cbb3140a01 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:46.803434 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c9f6d23a-22bf-4811-83c8-30cbb3140a01 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:47.038141 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:47.049049 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2dc32981-3a48-48f4-a855-8326af99f95e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.838114 Sep 01 05:29:47.053089 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 36/60] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:46 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:47.061802 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:47.067779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:47.091044 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:47.091580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:47.091959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:47.092652 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:47.093096 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:47.093504 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:47.171378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c9f6d23a-22bf-4811-83c8-30cbb3140a01 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:47.182150 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c9f6d23a-22bf-4811-83c8-30cbb3140a01 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1242 microversion: 2.1 time: 0.390704 Sep 01 05:29:47.199020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 25/61] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:46 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1242 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:47.237111 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:47.237111 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:47.248454 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:47.248953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:47.252350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:47.253182 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:47.253664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:47.254101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:47.481728 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:47.507560 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:47.520304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:47.529877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cd079d1e-bdab-4e69-bea8-1df598a305f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1333 microversion: 2.20 time: 0.290743 Sep 01 05:29:47.546603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 26/62] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:47 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1333 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:29:47.957249 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:47.966090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0ba1dee8-ab54-4a62-a989-61af730a4f1b tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.910968 Sep 01 05:29:47.994014 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 37/63] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:47 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:48.078379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:48.079560 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:48.083083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:48.096125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:48.100208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:48.100208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:48.100208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:48.100208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:48.100826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:48.208426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a0ffea5a-ae5a-469c-a8a2-14badcb7a7e5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:48.215268 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a0ffea5a-ae5a-469c-a8a2-14badcb7a7e5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:48.412017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:48.423734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3a03b5f4-e6f5-435b-b55d-59fb4d173f96 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.350138 Sep 01 05:29:48.424864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 27/64] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:48 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:48.520790 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a0ffea5a-ae5a-469c-a8a2-14badcb7a7e5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:48.549627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a0ffea5a-ae5a-469c-a8a2-14badcb7a7e5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1242 microversion: 2.1 time: 0.333724 Sep 01 05:29:48.552332 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 38/65] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:48 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1242 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:48.557268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:48.558769 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:48.570196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:48.570819 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:48.571487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:48.583521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:48.584314 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:48.584971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:48.769373 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:48.781588 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:48.796974 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:48.798960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f796748a-37ed-4d66-a287-b40bde29edaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1333 microversion: 2.20 time: 0.245717 Sep 01 05:29:48.815028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 28/66] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:48 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1333 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:29:49.004337 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:49.005097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:49.013764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.014247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.019890 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.020666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.021200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.021624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.268283 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:49.280470 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-43b149b5-cadf-4b98-b9f3-2f30b5175ba9 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.276537 Sep 01 05:29:49.280470 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 39/67] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:48 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:49.476218 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:49.477090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:49.487663 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.488477 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.489059 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.489938 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.496316 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.497173 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.554506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-1e8a674a-e222-4482-a064-d85181ba433c req-c54fb95a-ca2c-4edc-abac-c8a07d38565e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94115198-d3c1-40d0-af52-9c1dfe90a738", "tag": "ac59538c-4a89-48a7-94e8-3ff1fb0219e9"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:49.598790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-1e8a674a-e222-4482-a064-d85181ba433c req-c54fb95a-ca2c-4edc-abac-c8a07d38565e service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.599464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-1e8a674a-e222-4482-a064-d85181ba433c req-c54fb95a-ca2c-4edc-abac-c8a07d38565e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.607216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-1e8a674a-e222-4482-a064-d85181ba433c req-c54fb95a-ca2c-4edc-abac-c8a07d38565e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.681399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-1e8a674a-e222-4482-a064-d85181ba433c req-c54fb95a-ca2c-4edc-abac-c8a07d38565e service nova] Creating event network-changed:ac59538c-4a89-48a7-94e8-3ff1fb0219e9 for instance 94115198-d3c1-40d0-af52-9c1dfe90a738 on hv-cinder-83602 Sep 01 05:29:49.682305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-1e8a674a-e222-4482-a064-d85181ba433c req-c54fb95a-ca2c-4edc-abac-c8a07d38565e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 05:29:49.682876 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-1e8a674a-e222-4482-a064-d85181ba433c req-c54fb95a-ca2c-4edc-abac-c8a07d38565e service nova] Acquired lock "compute-rpcapi-router" {{(pid=121031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 05:29:49.684240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.685992 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.687790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.689378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.691029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.692893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.716075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.compute.rpcapi [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 05:29:49.719261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] Releasing lock "compute-rpcapi-router" {{(pid=121031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 05:29:49.767827 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-95eec0f8-998d-42f4-a648-c7af6aae1127 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.597715 Sep 01 05:29:49.769342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 29/68] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:29:49.790206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:49.790206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:49.816240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.818485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.818485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:49.828937 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:49.831125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:49.832768 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:50.083003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:50.086107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:50.100593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-06ffb5e7-1c8b-4dd7-b5b4-6d55287962d7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.621654 Sep 01 05:29:50.100593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 40/69] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:49 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:50.104308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:50.108880 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8c5ec7ef-22aa-4445-a44b-017f191dcb3e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1246 microversion: 2.1 time: 0.325521 Sep 01 05:29:50.112908 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:50.126633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 30/70] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:49 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1246 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:50.137940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:50.138462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:50.139140 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:50.142783 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-6c96c300-ee4a-4aa5-bc12-7c7a2534c83d req-cfb42055-8467-42a2-bf2e-f7d2793438db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85c8e8e-97e2-4132-a090-67148112e3e2", "tag": "2e24fdf5-3c73-4b91-a45c-ac8e7aac0e72"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:50.143574 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:50.144257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:50.144926 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:50.149752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:50.166914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6c96c300-ee4a-4aa5-bc12-7c7a2534c83d req-cfb42055-8467-42a2-bf2e-f7d2793438db service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:50.169548 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6c96c300-ee4a-4aa5-bc12-7c7a2534c83d req-cfb42055-8467-42a2-bf2e-f7d2793438db service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:50.169978 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-6c96c300-ee4a-4aa5-bc12-7c7a2534c83d req-cfb42055-8467-42a2-bf2e-f7d2793438db service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:50.234195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-6c96c300-ee4a-4aa5-bc12-7c7a2534c83d req-cfb42055-8467-42a2-bf2e-f7d2793438db service nova] Creating event network-changed:2e24fdf5-3c73-4b91-a45c-ac8e7aac0e72 for instance e85c8e8e-97e2-4132-a090-67148112e3e2 on hv-cinder-83602 Sep 01 05:29:50.246490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-6c96c300-ee4a-4aa5-bc12-7c7a2534c83d req-cfb42055-8467-42a2-bf2e-f7d2793438db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117880 Sep 01 05:29:50.248469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 31/71] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:50.300511 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:50.301329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:50.317201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:50.317201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:50.317201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:50.317201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:50.317517 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:50.317985 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:50.340909 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:50.350416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:50.357138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:50.358357 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b5341862-9663-4c19-9e5c-b3ecb0a4c5a7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1339 microversion: 2.20 time: 0.258296 Sep 01 05:29:50.359083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 41/72] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:50 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1339 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:50.594252 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:50.604353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f19eeeda-218d-4cd8-8c39-35cfd6f60999 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.308052 Sep 01 05:29:50.611092 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 32/73] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:50 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:51.121828 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:51.124585 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:51.138391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:51.139147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:51.142651 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:51.147567 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.148562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.149117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.150026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.150777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.151642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.152138 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.153067 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.153696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.154050 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.154523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.166245 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.310672 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:51.320090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3b76e486-bdb0-4172-b3ec-c7a49ca7a480 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1294 microversion: 2.1 time: 0.186063 Sep 01 05:29:51.322748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 33/74] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:51 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:51.399375 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:51.399998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:51.413232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.414357 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.414915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.415924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.416437 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.417020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.860863 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:51.871202 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:51.878761 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:51.881796 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3011b35c-6840-440c-ba23-5b486a38ffd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.491084 Sep 01 05:29:51.883978 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 34/75] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:51 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:51.888044 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:51.899676 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7ba32f56-b9cb-4c84-8982-397eaa233edd tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.782558 Sep 01 05:29:51.902178 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 42/76] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:51 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:51.910568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:51.910568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:51.926440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.929191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.930461 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:51.931653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:51.932320 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:51.932950 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.344085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:52.345519 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:52.352161 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:52.352645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:52.353078 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.353817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:52.354261 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:52.354730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.486064 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:52.490326 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:52.509618 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3759d223-20fb-406f-b240-991a1f155c84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1294 microversion: 2.1 time: 0.170163 Sep 01 05:29:52.522433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 43/77] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:52 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1294 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:52.522754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-43a6eaa7-88d2-4e2d-83b5-9bc1a256542f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.626436 Sep 01 05:29:52.522754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 35/78] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:51 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:52.905591 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:52.915689 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:52.925455 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:52.926129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:52.927128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:52.927894 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.928019 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:52.929688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:52.931523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:52.932173 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.937647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:52.938828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:52.939491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.940395 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:52.941057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:52.941534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:52.968420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:53.132852 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:53.141355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-91bcc0bc-8820-4d55-a7ed-e1673651cd12 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.220053 Sep 01 05:29:53.150908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 36/79] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:52 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:53.179292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:53.188767 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:53.191273 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:53.192475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d4c18b45-a833-4f68-a979-cc20ee32efae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.292158 Sep 01 05:29:53.193070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 44/80] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:52 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:29:53.419478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-8ceef3f5-3667-4749-84b6-3205d3c52213 req-22e9a370-afd3-46ce-bda2-b4effa23e158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4659e047-b384-4220-b0d3-26e9f67354c5", "tag": "7cbd2023-a83e-445a-b3a8-6aadb6c3c59c"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:53.443623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8ceef3f5-3667-4749-84b6-3205d3c52213 req-22e9a370-afd3-46ce-bda2-b4effa23e158 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:53.444113 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8ceef3f5-3667-4749-84b6-3205d3c52213 req-22e9a370-afd3-46ce-bda2-b4effa23e158 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:53.444536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8ceef3f5-3667-4749-84b6-3205d3c52213 req-22e9a370-afd3-46ce-bda2-b4effa23e158 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:53.473219 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-8ceef3f5-3667-4749-84b6-3205d3c52213 req-22e9a370-afd3-46ce-bda2-b4effa23e158 service nova] Creating event network-changed:7cbd2023-a83e-445a-b3a8-6aadb6c3c59c for instance 4659e047-b384-4220-b0d3-26e9f67354c5 on hv-cinder-83602 Sep 01 05:29:53.479682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-8ceef3f5-3667-4749-84b6-3205d3c52213 req-22e9a370-afd3-46ce-bda2-b4effa23e158 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065796 Sep 01 05:29:53.481795 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 37/81] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:29:53.534166 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:53.534962 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:53.537674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:53.537788 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:53.542716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:53.543433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:53.544083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:53.545110 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:53.545219 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:53.545906 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:53.546557 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:53.546663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:53.547168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:53.548775 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:53.549839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:53.550346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:53.630729 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:53.638938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-776d6eb1-5aa7-4619-8b52-ae14e91644e9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1302 microversion: 2.1 time: 0.109799 Sep 01 05:29:53.639590 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 38/82] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:53 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1302 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:53.705919 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:53.721736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ea69d88c-6396-4b15-a68b-6f51a1028b8f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.192865 Sep 01 05:29:53.722344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 45/83] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:53 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:54.164645 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:54.164645 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:54.174182 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.174929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.175684 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.176798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.177459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.178026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.216112 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:54.344878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:54.344878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.344878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.344878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.345549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.345549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.345549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.345920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:54.345920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e9a897b2-0c80-45bb-b34e-26fbbfd166ea tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.178408 Sep 01 05:29:54.345920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 39/84] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:54 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:54.346224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:54.386752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:54.393942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:54.395559 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:54.397736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-47f569c4-a81a-4d25-97fa-8043562d25d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.185529 Sep 01 05:29:54.398763 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 46/85] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:54 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:29:54.664835 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:54.665435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:54.671314 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.671995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.673106 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.673792 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.674239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.674683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.735889 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:54.744038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d7af84d3-80fe-41a4-b4d9-2d96eb384b4e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1302 microversion: 2.1 time: 0.082906 Sep 01 05:29:54.744331 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:54.744599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 40/86] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:54 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:54.745170 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:54.753306 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.753866 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.754390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.755118 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:54.755561 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:54.755990 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:54.888464 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:54.896257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c20503c1-ef9b-40b5-a552-e6c79acaac1e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.156574 Sep 01 05:29:54.896817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 47/87] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:54 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:29:55.360573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:55.369877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:55.369877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.369877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.369877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.370235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.370235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.370235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.421695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:55.422439 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:55.428787 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.435229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.435229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.435229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.435229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.435653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.534760 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:55.542350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7b35ebc7-e915-4935-a121-012351019549 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.185795 Sep 01 05:29:55.542948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 41/88] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:55 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:55.624486 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:55.634702 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:55.636528 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:55.637820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9f508c91-d79e-422e-8539-11e03e937a07 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.220799 Sep 01 05:29:55.638903 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 48/89] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:55 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:29:55.765208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:55.765821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:55.772426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.772904 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.773335 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.774023 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.774509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.774936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.839737 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:55.847323 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-da60f8e8-09cd-4614-902b-588c0f5ed85a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1302 microversion: 2.1 time: 0.086095 Sep 01 05:29:55.850083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 42/90] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:55 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:55.916959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:55.918181 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:55.925202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.926018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.926539 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:55.928001 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:55.928638 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:55.929242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.080743 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:56.090547 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5253c93e-c822-4ada-bf44-ba057375810d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.177363 Sep 01 05:29:56.091326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 49/91] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:55 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:56.562172 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:56.563342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:56.569174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:56.569643 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:56.570067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.570758 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:56.571196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:56.571607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.665072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:56.665677 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:56.671885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:56.672404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:56.672835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.673520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:56.674305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:56.674743 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.712150 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:56.727662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-44c39a47-9ca3-41ce-96bf-bfbb7b9980e5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.169101 Sep 01 05:29:56.728511 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 43/92] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:56 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:56.869230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:56.869959 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:56.876710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:56.877305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:56.878063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.878983 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:56.879430 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:56.888800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:56.889890 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:56.902516 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:56.904032 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:56.905519 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-856361c3-4603-46ce-92b5-506d3c298e7f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.244343 Sep 01 05:29:56.906062 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 50/93] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:56 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:56.956988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:56.965452 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-93163735-ce53-48a9-aca2-2925c7fea6e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1302 microversion: 2.1 time: 0.100554 Sep 01 05:29:56.979063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 44/94] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:56 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1302 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:57.114886 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:57.118519 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:57.121716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:57.122761 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:57.123650 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:57.124388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:57.125072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:57.126139 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:57.261286 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:57.269354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ec6a911e-108a-404f-bb78-cc9a4f9c476d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.158278 Sep 01 05:29:57.269997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 51/95] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:57 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:57.760870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:57.761472 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:57.771770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=32 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:57.787714 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:57.788651 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:57.802969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:57.802969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:57.802969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:57.802969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:57.928992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:57.929583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:57.940675 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:57.941191 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:57.951823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:57.951823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:57.951823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:57.951823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.374920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:58.386212 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:58.390749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:58.399975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4e72a984-168a-4c5f-b0fb-3f10f3591d3b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.470850 Sep 01 05:29:58.399975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 52/96] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:57 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:58.404996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:58.407331 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:58.413624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.414317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.414770 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.415458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.416131 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.416552 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.478483 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:58.487940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-26705e16-d31f-424c-baf2-d9ae1885881e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.738865 Sep 01 05:29:58.488774 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 45/97] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:57 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:58.499857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:58.500431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:58.515122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.516720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.523838 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.523838 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:58.523838 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:58.523838 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:58.530148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:58.532892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=26 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:58.546278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-50e978d9-4b90-4069-8902-209def20ba84 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1300 microversion: 2.1 time: 0.143173 Sep 01 05:29:58.546924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 53/98] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:58 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1300 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:59.125651 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:59.136267 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-29058a6e-dcf2-469a-a3be-84e1c7a9f64f tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.646241 Sep 01 05:29:59.136985 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 46/99] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:58 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:59.367835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-b4029313-db3c-40f2-a4f2-082598d1d275 req-c57459ae-8f33-4fe0-a518-9335d8d1e4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335b0b3d-5511-4399-b007-7431ea003409", "name": "network-vif-plugged", "status": "completed", "tag": "0fac7473-6d8d-45ab-adf4-22c2f3a04dd7"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:29:59.384468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-b4029313-db3c-40f2-a4f2-082598d1d275 req-c57459ae-8f33-4fe0-a518-9335d8d1e4bf service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.385340 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-b4029313-db3c-40f2-a4f2-082598d1d275 req-c57459ae-8f33-4fe0-a518-9335d8d1e4bf service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.386006 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-b4029313-db3c-40f2-a4f2-082598d1d275 req-c57459ae-8f33-4fe0-a518-9335d8d1e4bf service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:59.399818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-b4029313-db3c-40f2-a4f2-082598d1d275 req-c57459ae-8f33-4fe0-a518-9335d8d1e4bf service nova] Creating event network-vif-plugged:0fac7473-6d8d-45ab-adf4-22c2f3a04dd7 for instance 335b0b3d-5511-4399-b007-7431ea003409 on hv-cinder-83602 Sep 01 05:29:59.406238 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-b4029313-db3c-40f2-a4f2-082598d1d275 req-c57459ae-8f33-4fe0-a518-9335d8d1e4bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326315 Sep 01 05:29:59.407409 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 54/100] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:29:59.423107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:59.423810 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:59.432040 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.435888 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.435888 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:59.436104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.442532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.442532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:59.512326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:59.513024 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:59.524314 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.524719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.525150 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:59.525863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.526293 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.526740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:59.712754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=8 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:29:59.810773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:59.817787 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:59.823975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a73f210a-b431-4ba3-b0d2-730a67eac1e2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.310841 Sep 01 05:29:59.823975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 55/101] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:59 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:29:59.830777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:59.833298 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:29:59.835466 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b5c02e7f-412d-40a7-a81f-a930568f46a2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.417690 Sep 01 05:29:59.836606 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 47/102] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:29:59 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:29:59.838840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:29:59.839460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:29:59.847247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.849621 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.850385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:29:59.858549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:29:59.858549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:29:59.859574 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.158873 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:00.160291 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:00.166637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:00.167113 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:00.167532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.170589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:00.173557 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:00.174240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.304822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:00.315983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ad2c6bbe-c771-41ba-b027-720fbdfa734b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1368 microversion: 2.1 time: 0.494869 Sep 01 05:30:00.316874 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 56/103] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:29:59 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1368 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:00.398316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:00.409159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e76aa448-13f5-4029-99e3-527b68260ccc tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.253841 Sep 01 05:30:00.409872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 48/104] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:00 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:00.844483 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:00.845020 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:00.851345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:00.851837 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:00.852322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.853013 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:00.853458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:00.853864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.864123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:00.864940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:00.871275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:00.871971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:00.872545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.873381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:00.873823 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:00.874231 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:00.996039 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:01.003882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-eeafd028-b933-4405-9e37-f58d5a0a27e6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.163662 Sep 01 05:30:01.004462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 57/105] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:00 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:01.014500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-d50f59dd-d899-4bb6-869e-9a1048016d38 req-74a15e42-19ca-4081-9723-1be7e762c923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4956c0-5c09-4733-a34a-a06dfb38a0ff", "tag": "2270f934-97de-4f7e-b1b1-847058bb4fd1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:01.024504 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-d50f59dd-d899-4bb6-869e-9a1048016d38 req-74a15e42-19ca-4081-9723-1be7e762c923 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:01.024972 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-d50f59dd-d899-4bb6-869e-9a1048016d38 req-74a15e42-19ca-4081-9723-1be7e762c923 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:01.030617 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-d50f59dd-d899-4bb6-869e-9a1048016d38 req-74a15e42-19ca-4081-9723-1be7e762c923 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:01.040184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-d50f59dd-d899-4bb6-869e-9a1048016d38 req-74a15e42-19ca-4081-9723-1be7e762c923 service nova] Creating event network-changed:2270f934-97de-4f7e-b1b1-847058bb4fd1 for instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff on hv-cinder-83602 Sep 01 05:30:01.045146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-d50f59dd-d899-4bb6-869e-9a1048016d38 req-74a15e42-19ca-4081-9723-1be7e762c923 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039353 Sep 01 05:30:01.046385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 58/106] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:01.075120 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:01.086241 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:01.086241 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:01.087160 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-818f4403-d12b-49a5-91b4-671d82ce1638 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.227457 Sep 01 05:30:01.087714 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 49/107] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:30:00 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:30:01.341106 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:01.343516 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:01.348529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:01.348999 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:01.349466 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:01.350125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:01.350649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:01.350996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:01.355051 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:01.420737 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-d5555d9f-2154-4421-82e3-dd5f91f988b7 req-d8916202-2c41-44a4-82d9-9cdf21f23211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94115198-d3c1-40d0-af52-9c1dfe90a738", "name": "network-vif-plugged", "status": "completed", "tag": "ac59538c-4a89-48a7-94e8-3ff1fb0219e9"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:01.448322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d5555d9f-2154-4421-82e3-dd5f91f988b7 req-d8916202-2c41-44a4-82d9-9cdf21f23211 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:01.452468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d5555d9f-2154-4421-82e3-dd5f91f988b7 req-d8916202-2c41-44a4-82d9-9cdf21f23211 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:01.456223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d5555d9f-2154-4421-82e3-dd5f91f988b7 req-d8916202-2c41-44a4-82d9-9cdf21f23211 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:01.470469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-d5555d9f-2154-4421-82e3-dd5f91f988b7 req-d8916202-2c41-44a4-82d9-9cdf21f23211 service nova] Creating event network-vif-plugged:ac59538c-4a89-48a7-94e8-3ff1fb0219e9 for instance 94115198-d3c1-40d0-af52-9c1dfe90a738 on hv-cinder-83602 Sep 01 05:30:01.482767 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-d5555d9f-2154-4421-82e3-dd5f91f988b7 req-d8916202-2c41-44a4-82d9-9cdf21f23211 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065868 Sep 01 05:30:01.483489 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 50/108] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:01.489971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:01.490894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:01.499155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:01.500329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:01.500329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:01.501066 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:01.501589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:01.502121 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:01.511681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:01.534834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0aff0810-9015-4df5-8239-f5d2264354d8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1368 microversion: 2.1 time: 0.198006 Sep 01 05:30:01.537461 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 59/109] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:01 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:01.650371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:01.658535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4a4604cd-3ff3-4bf4-8651-2df314d04b44 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.173557 Sep 01 05:30:01.659094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 51/110] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:01 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:02.024665 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:02.025257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:02.031978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.032679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.033261 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.034099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.034714 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.035275 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.110691 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:02.111746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:02.118208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.118208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.118653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.119487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.123522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.123522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.224465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:02.232504 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fc2ad97b-d3f6-4d34-a355-422c6ff1ae42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.211644 Sep 01 05:30:02.233200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 60/111] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:02 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:02.278116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:02.286225 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:02.287961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:02.289060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0ee7399b-a267-47e7-85b9-fa74c74ec953 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.183275 Sep 01 05:30:02.289610 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 52/112] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:30:02 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:30:02.559513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:02.560320 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:02.568625 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.569110 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.577210 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.577937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.578395 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.578845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.679841 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:02.684356 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:02.700481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.701042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.701483 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.702392 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:02.704640 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:02.705376 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:02.802217 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:02.810655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f0547148-fdbb-4972-8965-af5344d22aef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1368 microversion: 2.1 time: 0.257147 Sep 01 05:30:02.814791 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 61/113] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:02 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:02.868470 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:02.876574 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c69da655-5000-4178-9121-7b12c5c0d8ae tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1314 microversion: 2.1 time: 0.201186 Sep 01 05:30:02.877528 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 53/114] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:02 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:03.255666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:03.256785 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:03.262969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.263589 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.264119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.264886 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.265402 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.265879 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.312163 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:03.312810 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:03.318986 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.319469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.319894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.320745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.321349 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.321922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.341026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:03.418838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:03.430983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9d47dc11-f883-48c7-9099-93a51b1ba33e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.180244 Sep 01 05:30:03.431727 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 62/115] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:03 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:03.509163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-f7344dbd-28bf-45e0-a198-3751e83ead81 req-61ced6c2-fb4c-4624-b4a2-2caeeadd6a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85c8e8e-97e2-4132-a090-67148112e3e2", "name": "network-vif-plugged", "status": "completed", "tag": "2e24fdf5-3c73-4b91-a45c-ac8e7aac0e72"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:03.518785 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f7344dbd-28bf-45e0-a198-3751e83ead81 req-61ced6c2-fb4c-4624-b4a2-2caeeadd6a15 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.519516 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f7344dbd-28bf-45e0-a198-3751e83ead81 req-61ced6c2-fb4c-4624-b4a2-2caeeadd6a15 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.520110 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f7344dbd-28bf-45e0-a198-3751e83ead81 req-61ced6c2-fb4c-4624-b4a2-2caeeadd6a15 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.531927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-f7344dbd-28bf-45e0-a198-3751e83ead81 req-61ced6c2-fb4c-4624-b4a2-2caeeadd6a15 service nova] Creating event network-vif-plugged:2e24fdf5-3c73-4b91-a45c-ac8e7aac0e72 for instance e85c8e8e-97e2-4132-a090-67148112e3e2 on hv-cinder-83602 Sep 01 05:30:03.537451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-f7344dbd-28bf-45e0-a198-3751e83ead81 req-61ced6c2-fb4c-4624-b4a2-2caeeadd6a15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Sep 01 05:30:03.538605 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 63/116] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:03.564616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:03.586551 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:03.588923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:03.590542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-485d7414-0016-4c28-9347-969d0024e97b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.282224 Sep 01 05:30:03.591534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 54/117] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:30:03 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:30:03.832036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:03.832826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:03.839802 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.840431 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.840932 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.841712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.845231 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.845231 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.898060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:03.898812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:03.905124 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.905673 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.906630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:03.907695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:03.908212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:03.908889 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:04.061551 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:04.073887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-97a5d81d-692b-4f82-8c2d-8563b99aac2f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1368 microversion: 2.1 time: 0.246597 Sep 01 05:30:04.075697 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 64/118] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:03 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:04.371155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:04.380389 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-759073df-cbda-471c-b7c3-613046f7c5cf tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1501 microversion: 2.1 time: 0.486695 Sep 01 05:30:04.380965 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 55/119] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:03 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1501 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:04.454716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:04.454716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:04.460201 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:04.460682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:04.461111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:04.461839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:04.468240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:04.468240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:04.615432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:04.616220 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:04.622717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:04.623199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:04.624098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:04.627578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:04.627578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:04.627578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:04.640594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:04.648647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-35b9bbe2-4e36-4bed-8219-800b822c7f42 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1322 microversion: 2.1 time: 0.200014 Sep 01 05:30:04.653022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 65/120] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:04 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:04.884110 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:04.892549 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:04.894050 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:04.895514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e4e802ce-af09-4338-b9aa-de8be8fa67b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.285251 Sep 01 05:30:04.925552 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 56/121] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:30:04 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:30:05.097754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:05.098366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:05.104220 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.104700 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.105139 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:05.105824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.106274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.106757 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:05.261024 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:05.272226 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4361fb53-c9ad-47f2-8d3a-749d79c03f86 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1368 microversion: 2.1 time: 0.179060 Sep 01 05:30:05.273284 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 66/122] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:05 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:05.556725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-298d5ee8-cb83-45e3-a1d1-bec4d27e371c req-912e4b55-01bf-42c5-92ae-9ddf40384565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4659e047-b384-4220-b0d3-26e9f67354c5", "name": "network-vif-plugged", "status": "completed", "tag": "7cbd2023-a83e-445a-b3a8-6aadb6c3c59c"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:05.569411 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-298d5ee8-cb83-45e3-a1d1-bec4d27e371c req-912e4b55-01bf-42c5-92ae-9ddf40384565 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.570316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-298d5ee8-cb83-45e3-a1d1-bec4d27e371c req-912e4b55-01bf-42c5-92ae-9ddf40384565 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.571190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-298d5ee8-cb83-45e3-a1d1-bec4d27e371c req-912e4b55-01bf-42c5-92ae-9ddf40384565 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:05.587349 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-298d5ee8-cb83-45e3-a1d1-bec4d27e371c req-912e4b55-01bf-42c5-92ae-9ddf40384565 service nova] Creating event network-vif-plugged:7cbd2023-a83e-445a-b3a8-6aadb6c3c59c for instance 4659e047-b384-4220-b0d3-26e9f67354c5 on hv-cinder-83602 Sep 01 05:30:05.602327 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-298d5ee8-cb83-45e3-a1d1-bec4d27e371c req-912e4b55-01bf-42c5-92ae-9ddf40384565 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051019 Sep 01 05:30:05.604671 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 57/123] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:05.673390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:05.673390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:05.678073 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.678594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.679204 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:05.680009 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.680688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.681297 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:05.818090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:05.826239 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6b0d4b8c-f3f9-4fe2-a88e-163d938bb9af tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1516 microversion: 2.1 time: 0.160215 Sep 01 05:30:05.826965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 67/124] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:05 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:05.849386 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:05.851742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:05.857982 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.858493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.858930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:05.859665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.860140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.860560 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:05.924955 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:05.925800 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:05.941439 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'flavor' on Instance uuid 94115198-d3c1-40d0-af52-9c1dfe90a738 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:30:05.950351 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.954782 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.958223 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:05.959091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:05.959620 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:05.960115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.161035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:06.169024 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:06.170474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:06.172412 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b982241f-a0ad-4c32-9be6-4dfc578a885e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.251352 Sep 01 05:30:06.173150 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 68/125] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:30:05 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:30:06.292853 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:06.293454 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:06.303145 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:06.304069 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:06.304708 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.305610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:06.306060 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:06.306563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.453043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-81f68ce8-573c-4851-aaf3-0f0047ffdf44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738/action" status: 200 len: 32 microversion: 2.1 time: 0.608066 Sep 01 05:30:06.454968 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 58/126] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:30:05 2022] POST /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738/action => generated 32 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:30:06.463803 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "834f05f8-f9fd-4809-a523-1568752a00dd"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:06.466268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:06.476261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:06.476735 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:06.477159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.477839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:06.478350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:06.478801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.591607 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:06.602372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-00424c9b-6276-465c-be8a-7d4a0f9ed33d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1368 microversion: 2.1 time: 0.313201 Sep 01 05:30:06.602967 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 69/127] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:06 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1368 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:06.632063 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:06.632662 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:06.645206 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:06.645700 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:06.646230 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.654976 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:06.655680 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:06.657063 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:06.819726 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:06.827344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c29ec873-110a-4168-9b89-50bcf2211379 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.199139 Sep 01 05:30:06.828417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 70/128] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:06 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:07.195231 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:07.196318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:07.203457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.204254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.204901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.205645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.207029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.207682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.364227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:07.372824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:07.374272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:07.376070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b5aac7d3-3c0a-4dcb-8510-b490574140e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1407 microversion: 2.20 time: 0.184991 Sep 01 05:30:07.376636 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 71/129] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:30:07 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:30:07.619691 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-82040c70-f127-45f8-a88c-71db33e44189 req-c38797c0-c090-4fe3-8dbe-5ae166a57984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4956c0-5c09-4733-a34a-a06dfb38a0ff", "name": "network-vif-plugged", "status": "completed", "tag": "2270f934-97de-4f7e-b1b1-847058bb4fd1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:07.644114 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-82040c70-f127-45f8-a88c-71db33e44189 req-c38797c0-c090-4fe3-8dbe-5ae166a57984 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.644597 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-82040c70-f127-45f8-a88c-71db33e44189 req-c38797c0-c090-4fe3-8dbe-5ae166a57984 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.645189 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-82040c70-f127-45f8-a88c-71db33e44189 req-c38797c0-c090-4fe3-8dbe-5ae166a57984 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.679335 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-82040c70-f127-45f8-a88c-71db33e44189 req-c38797c0-c090-4fe3-8dbe-5ae166a57984 service nova] Creating event network-vif-plugged:2270f934-97de-4f7e-b1b1-847058bb4fd1 for instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff on hv-cinder-83602 Sep 01 05:30:07.684550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-82040c70-f127-45f8-a88c-71db33e44189 req-c38797c0-c090-4fe3-8dbe-5ae166a57984 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068497 Sep 01 05:30:07.685508 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 72/130] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:07.690671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:07.691548 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:07.707394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.708318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.708752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.709541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.709994 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.710429 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.818175 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-17aa08c7-85d0-410b-9f1d-01e44626a27e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "POST /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.359035 Sep 01 05:30:07.818175 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 59/131] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:30:06 2022] POST /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409/os-volume_attachments => generated 194 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:07.876054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:07.879393 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:07.912983 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.913654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.914093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.914837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:07.915482 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:07.916688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:07.997257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:08.006947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2f911b49-b51b-4b2a-859d-0689c8f3275c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1368 microversion: 2.1 time: 0.320154 Sep 01 05:30:08.014497 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 73/132] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:07 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:08.117271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:08.126190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1d4d7472-ca2b-485a-b714-dd5d48a8d1e1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.273455 Sep 01 05:30:08.126793 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 60/133] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:07 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:08.399200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:08.400050 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:08.406685 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:08.407386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:08.408175 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:08.409029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:08.410577 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:08.411631 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:08.564522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:08.572685 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:08.574118 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:08.575277 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fa23b23b-29a6-40c1-93ea-b4e12990f7fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1598 microversion: 2.20 time: 0.180143 Sep 01 05:30:08.575828 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 74/134] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:30:08 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1598 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:30:08.598669 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:08.599142 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:08.605665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:08.606191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:08.606852 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:08.614665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:08.614665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:08.614665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:08.692189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2ace50e5-8531-45a2-a0f3-f8f6a9412dac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097382 Sep 01 05:30:08.692788 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 61/135] 10.222.0.16 () {60 vars in 1316 bytes} [Thu Sep 1 05:30:08 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:30:09.028888 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:09.030134 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:09.036854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:09.037467 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:09.037966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:09.038814 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:09.039474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:09.040070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:09.149906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:09.150823 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:09.156906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:09.157644 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:09.158261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:09.159155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:09.159780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:09.160379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:09.337462 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:09.350471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5b105536-32f3-4501-a49b-ddf44acfedd8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.204429 Sep 01 05:30:09.351310 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 62/136] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:09 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:09.548993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:09.556509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-567568d0-888d-441b-b619-cebdae9d482e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1368 microversion: 2.1 time: 0.531422 Sep 01 05:30:09.557270 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 75/137] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:09 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1368 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:10.365834 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-0c84aa71-57bd-4999-a291-2fb7e7eb62be req-e7e30b98-33cc-4bba-a2e5-73d41c2249ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4659e047-b384-4220-b0d3-26e9f67354c5", "tag": "7cbd2023-a83e-445a-b3a8-6aadb6c3c59c"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:10.373852 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:10.374737 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:10.377752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0c84aa71-57bd-4999-a291-2fb7e7eb62be req-e7e30b98-33cc-4bba-a2e5-73d41c2249ce service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.378669 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0c84aa71-57bd-4999-a291-2fb7e7eb62be req-e7e30b98-33cc-4bba-a2e5-73d41c2249ce service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.379328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-0c84aa71-57bd-4999-a291-2fb7e7eb62be req-e7e30b98-33cc-4bba-a2e5-73d41c2249ce service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:10.381130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.381616 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.382070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:10.382802 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.383249 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.383666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:10.396752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-0c84aa71-57bd-4999-a291-2fb7e7eb62be req-e7e30b98-33cc-4bba-a2e5-73d41c2249ce service nova] Creating event network-changed:7cbd2023-a83e-445a-b3a8-6aadb6c3c59c for instance 4659e047-b384-4220-b0d3-26e9f67354c5 on hv-cinder-83602 Sep 01 05:30:10.403935 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-0c84aa71-57bd-4999-a291-2fb7e7eb62be req-e7e30b98-33cc-4bba-a2e5-73d41c2249ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042326 Sep 01 05:30:10.405178 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 63/138] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:10.579819 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:10.580522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:10.580647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:10.590183 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6de3aad5-c603-4ad3-aaf5-24908c9a5222 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.221170 Sep 01 05:30:10.592784 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 76/139] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:10 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:10.596052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.596538 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.596966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:10.597653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.599020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.599543 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:10.871159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:10.891970 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-94667a0e-87cb-45a8-89b2-d212143642c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1558 microversion: 2.1 time: 0.317818 Sep 01 05:30:10.894025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 64/140] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:10 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1558 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:10.923635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:10.924122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:10.937381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.937381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.937381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:10.937381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:10.937784 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:10.937784 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:11.000588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:11.109669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ea7f94d3-fc38-46d0-ab17-cd27b4a81597 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189313 Sep 01 05:30:11.110523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 77/141] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 05:30:10 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:11.614435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:11.615121 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:11.623025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:11.623682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:11.624655 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:11.625497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:11.626146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:11.626693 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:11.807809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:11.815566 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4ca61e88-3733-4293-84eb-8c7533956c4f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.205592 Sep 01 05:30:11.816413 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 65/142] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:11 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:12.437656 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-0d3f400f-283a-479c-bf6d-72f1280f95a0 req-f668be4d-8254-4417-bce9-13fa6b4784e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4956c0-5c09-4733-a34a-a06dfb38a0ff", "tag": "2270f934-97de-4f7e-b1b1-847058bb4fd1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:12.449347 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-0d3f400f-283a-479c-bf6d-72f1280f95a0 req-f668be4d-8254-4417-bce9-13fa6b4784e4 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:12.450013 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-0d3f400f-283a-479c-bf6d-72f1280f95a0 req-f668be4d-8254-4417-bce9-13fa6b4784e4 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:12.450695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-0d3f400f-283a-479c-bf6d-72f1280f95a0 req-f668be4d-8254-4417-bce9-13fa6b4784e4 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:12.463144 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-0d3f400f-283a-479c-bf6d-72f1280f95a0 req-f668be4d-8254-4417-bce9-13fa6b4784e4 service nova] Creating event network-changed:2270f934-97de-4f7e-b1b1-847058bb4fd1 for instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff on hv-cinder-83602 Sep 01 05:30:12.470512 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-0d3f400f-283a-479c-bf6d-72f1280f95a0 req-f668be4d-8254-4417-bce9-13fa6b4784e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037026 Sep 01 05:30:12.470512 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 78/143] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:12.837367 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:12.838027 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:12.845522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:12.846221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:12.846840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:12.847731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:12.848326 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:12.848897 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:13.018585 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:13.038961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6a36f8ff-78bf-44ea-b960-7dac105882a8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.194165 Sep 01 05:30:13.039851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 66/144] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:12 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:14.061449 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:14.062203 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:14.068308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:14.068783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:14.069210 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:14.069887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:14.070334 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:14.070773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:14.237429 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:14.245165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b5a3ccec-0bf8-41a7-be38-d0839a19bc68 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.188146 Sep 01 05:30:14.245881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 79/145] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:14 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:15.267647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:15.268432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:15.275135 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:15.275855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:15.276570 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:15.277468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:15.278482 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:15.279123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:15.447866 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:15.457151 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-314364fb-ed63-492f-b9a2-b7efe8d081f0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.194017 Sep 01 05:30:15.458136 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 67/146] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:15 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:16.481420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:16.482019 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:16.488272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:16.488745 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:16.491004 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:16.491788 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:16.492290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:16.492937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:16.674034 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:16.683012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9b0d08b4-ee93-4f52-bbca-7e2ef0ec24d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.208489 Sep 01 05:30:16.697101 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 80/147] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:16 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:17.704462 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:17.705098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:17.711704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:17.712300 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:17.712641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:17.717254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:17.717254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:17.717254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:17.861157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:17.870506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-88202039-51e3-426a-83a4-a11d15c16e7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.169939 Sep 01 05:30:17.871204 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 68/148] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:17 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:18.892857 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:18.893441 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:18.899221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:18.899696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:18.900143 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:18.900803 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:18.901250 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:18.901667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:19.029344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:19.037164 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-494b8c34-5891-4ac7-938b-8c91f34d91d8 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.148703 Sep 01 05:30:19.037766 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 81/149] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:18 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:20.057425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:20.058025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:20.064824 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:20.065333 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:20.065767 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:20.066475 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:20.066925 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:20.067343 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:20.097350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:20.247069 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:20.255588 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3a151b46-ff5b-4065-90fc-0874c92d98df tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.202119 Sep 01 05:30:20.256168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 69/150] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:20 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:20.461833 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1600948589", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "networks": [{"uuid": "232bad13-3140-4ff0-ab8b-8fdeb42cf55f"}]}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:20.524690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] validate_networks() for [('232bad13-3140-4ff0-ab8b-8fdeb42cf55f', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:30:21.090174 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:30:21.090614 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:30:21.092378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:30:21.093021 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:30:21.093624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:30:21.103822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:21.104297 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:21.104727 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:21.105433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:21.105878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:21.106291 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:21.123550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Getting quotas for project 1297d0249cf34d7290e867124be62377. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:30:21.128358 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Getting quotas for user 881062ec3efc4445a43e1ff772b09153 and project 1297d0249cf34d7290e867124be62377. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:30:21.139473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:30:21.141858 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:30:21.281846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:21.282468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:21.284758 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=85 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:21.289664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:21.290134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:21.290591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:21.291262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:21.291702 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:21.292144 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:21.335611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b6721093-14ff-4068-b249-34e0d246b607 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877661 Sep 01 05:30:21.336763 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 82/151] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:30:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:30:21.353242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e38ba03c-583e-45e6-bfc6-cc7547432aae tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:21.355111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e38ba03c-583e-45e6-bfc6-cc7547432aae tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:21.419109 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e38ba03c-583e-45e6-bfc6-cc7547432aae tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:21.427071 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e38ba03c-583e-45e6-bfc6-cc7547432aae tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1214 microversion: 2.1 time: 0.083247 Sep 01 05:30:21.427645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 83/152] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:21 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:21.447428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:21.455067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cb237a7b-b724-415e-a220-c6082ecc231e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.177881 Sep 01 05:30:21.455899 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 70/153] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:21 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:21.671856 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:21.672343 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:21.677597 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:21.684172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:21.684726 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:21.685067 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:21.685746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:21.686294 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:21.691184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:21.720379 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:30:22.070782 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0f869020-f913-4b89-b608-4e754a328708 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 204 len: 0 microversion: 2.1 time: 0.402549 Sep 01 05:30:22.071364 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 84/154] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:30:21 2022] DELETE /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:30:22.079908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:22.080504 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:22.087577 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:22.088407 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:22.088840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:22.089534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:22.089980 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:22.090394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:22.259678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:22.270147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f45cb8a6-c2ca-48bf-8c49-d6009779ca7d tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1553 microversion: 2.1 time: 0.194159 Sep 01 05:30:22.270735 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 71/155] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:22 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:22.449932 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2dc0b44b-6dff-412e-a780-2afdf1131bc5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:22.450635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2dc0b44b-6dff-412e-a780-2afdf1131bc5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:22.476636 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:22.477237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:22.484273 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:22.484764 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:22.485194 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:22.485887 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:22.486330 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:22.487011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:22.506493 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2dc0b44b-6dff-412e-a780-2afdf1131bc5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:22.513359 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2dc0b44b-6dff-412e-a780-2afdf1131bc5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1214 microversion: 2.1 time: 0.067834 Sep 01 05:30:22.513928 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 85/156] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:22 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:22.652625 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:22.661307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2e752036-3d16-4a85-ae2f-8c90a2324fbe tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.188638 Sep 01 05:30:22.662208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 72/157] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:22 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:23.291566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:23.292177 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:23.298670 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:23.299150 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:23.299573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:23.300253 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:23.300701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:23.301120 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:23.509579 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:23.522834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f4875f4b-6e83-461e-b974-a50b28642747 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1553 microversion: 2.1 time: 0.235164 Sep 01 05:30:23.523924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 86/158] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:23 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:23.536262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:23.537157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:23.544299 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:23.544769 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:23.545192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:23.546004 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:23.546637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:23.547080 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:23.616687 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:23.628805 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4b29e98c-9765-4437-b8b3-e541ecbac18b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1218 microversion: 2.1 time: 0.097237 Sep 01 05:30:23.629765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 73/159] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:23 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:23.681144 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:23.681784 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:23.695177 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:23.695662 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:23.696092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:23.696782 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:23.697227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:23.697958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:23.838060 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:23.858529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-157c7293-c0e5-46c3-b914-9b35aa5e2e3b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.168994 Sep 01 05:30:23.858529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 87/160] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:23 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:24.544718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:24.545972 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:24.552704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:24.553175 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:24.553662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:24.554754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:24.555636 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:24.556250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:24.651788 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:24.652475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:24.659639 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:24.660109 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:24.660534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:24.661205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:24.661646 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:24.662059 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:24.710984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:24.719715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-19eb282b-55d0-45ce-bc5b-7adc4581054e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1553 microversion: 2.1 time: 0.178908 Sep 01 05:30:24.720288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 74/161] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:24 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:24.728199 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:24.736463 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-bd97dd37-793a-4683-88a3-9ca0b12cb777 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1210 microversion: 2.1 time: 0.089296 Sep 01 05:30:24.737036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 88/162] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:24 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:24.869065 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:24.869697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:24.876453 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:24.877071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:24.877613 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:24.878493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:24.879094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:24.879671 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:25.127752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:25.139985 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7663fdb1-458e-469c-abbb-76c642098032 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.274389 Sep 01 05:30:25.141861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 75/163] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:24 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:25.740844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-37226293-bd1a-48e1-a06d-3372575abab7 req-cef6b0e8-66d4-42e4-91c3-183f745522dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335b0b3d-5511-4399-b007-7431ea003409", "name": "network-vif-deleted", "tag": "0fac7473-6d8d-45ab-adf4-22c2f3a04dd7"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:25.740844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-37226293-bd1a-48e1-a06d-3372575abab7 req-cef6b0e8-66d4-42e4-91c3-183f745522dd service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:25.740844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-37226293-bd1a-48e1-a06d-3372575abab7 req-cef6b0e8-66d4-42e4-91c3-183f745522dd service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:25.740844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-37226293-bd1a-48e1-a06d-3372575abab7 req-cef6b0e8-66d4-42e4-91c3-183f745522dd service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:25.744442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:25.744442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:25.748808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:25.749467 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:25.750051 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:25.750907 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:25.751684 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:25.752231 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:25.756502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-37226293-bd1a-48e1-a06d-3372575abab7 req-cef6b0e8-66d4-42e4-91c3-183f745522dd service nova] Creating event network-vif-deleted:0fac7473-6d8d-45ab-adf4-22c2f3a04dd7 for instance 335b0b3d-5511-4399-b007-7431ea003409 on hv-cinder-83602 Sep 01 05:30:25.761498 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-37226293-bd1a-48e1-a06d-3372575abab7 req-cef6b0e8-66d4-42e4-91c3-183f745522dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036848 Sep 01 05:30:25.762088 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 89/164] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:25.767477 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:25.768126 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:25.774987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:25.775734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:25.776085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:25.776772 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:25.777216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:25.777706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:25.828779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:25.838939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7b6324a0-b2ad-4bb5-985f-466640db08f7 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1511 microversion: 2.1 time: 0.101446 Sep 01 05:30:25.839837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 76/165] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:25 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:25.859312 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:25.867622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7fdebc2e-cccb-429e-84e4-0db7e2514a36 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1266 microversion: 2.1 time: 0.104146 Sep 01 05:30:25.868197 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 90/166] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:25 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:26.162322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:26.162936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:26.168881 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:26.169589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:26.170043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:26.171381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:26.171825 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:26.172237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:26.393807 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:26.405565 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a267472c-a63c-4cd5-ad38-27c02dc1216d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.244883 Sep 01 05:30:26.406902 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 77/167] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:26 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:26.859807 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:26.861181 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:26.868605 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:26.869089 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:26.869997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:26.870714 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:26.871451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:26.871869 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:26.890774 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:26.892295 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:26.900803 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:26.901432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:26.901975 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:26.902879 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:26.904017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:26.909918 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:26.949905 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:26.964392 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-74479768-9247-448b-a00c-f5cc5d381df1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1345 microversion: 2.1 time: 0.108673 Sep 01 05:30:26.978844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 91/168] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:26 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:26.990996 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:27.007158 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a75226bb-780d-48c6-88ee-88afba59d881 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1272 microversion: 2.1 time: 0.121050 Sep 01 05:30:27.008342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 78/169] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:26 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:27.427281 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:27.427902 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:27.433724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:27.434207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:27.434655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:27.435326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:27.436311 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:27.436711 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:27.603630 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:27.612757 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6318cb1e-15df-4e91-9fcb-750e89336de3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.189311 Sep 01 05:30:27.613353 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 92/170] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:27 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:27.985991 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:27.986782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:27.993553 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:27.994022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:27.994478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:27.995160 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:27.995629 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:27.995999 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.031615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:28.032222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:28.033246 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:28.035779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:28.036459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.038767 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lazy-loading 'fault' on Instance uuid 335b0b3d-5511-4399-b007-7431ea003409 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:30:28.051445 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:28.052469 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:28.053204 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.054137 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:28.054825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:28.055471 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.136672 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55c9d3a3577746a4ad7406fe4396eaee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc23f8d119514ad595637967b626e87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:28.148379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4b2445bb-87ca-4e64-a9b1-65b64ebc4d36 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 200 len: 1350 microversion: 2.1 time: 0.167067 Sep 01 05:30:28.159999 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 79/171] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:27 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 1350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:28.250523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:28.258616 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1ba7b2f0-65c4-4940-b39f-e506ef2d018e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.233213 Sep 01 05:30:28.259191 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 93/172] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:28 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:28.340304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-61f9a5de-6b09-4c75-ae3f-2d0b941026de req-ec5a5c1b-af0e-4113-9a93-3ce1c6bc7fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a54e84d-9d5b-48b9-aee6-a73196cd4f27", "tag": "40a18e23-320e-4f3e-a3e1-2927d5dea00e"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:28.355579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-61f9a5de-6b09-4c75-ae3f-2d0b941026de req-ec5a5c1b-af0e-4113-9a93-3ce1c6bc7fe3 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:28.356054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-61f9a5de-6b09-4c75-ae3f-2d0b941026de req-ec5a5c1b-af0e-4113-9a93-3ce1c6bc7fe3 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:28.356481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-61f9a5de-6b09-4c75-ae3f-2d0b941026de req-ec5a5c1b-af0e-4113-9a93-3ce1c6bc7fe3 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.367988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-61f9a5de-6b09-4c75-ae3f-2d0b941026de req-ec5a5c1b-af0e-4113-9a93-3ce1c6bc7fe3 service nova] Creating event network-changed:40a18e23-320e-4f3e-a3e1-2927d5dea00e for instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 on hv-cinder-83602 Sep 01 05:30:28.373469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-61f9a5de-6b09-4c75-ae3f-2d0b941026de req-ec5a5c1b-af0e-4113-9a93-3ce1c6bc7fe3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036641 Sep 01 05:30:28.374507 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 80/173] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:28.649736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:28.650788 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:28.657746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:28.658562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:28.659179 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.660073 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:28.660523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:28.661097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:28.806296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:28.814850 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cdad99ba-f6f8-4e5a-b7cf-69a060b4d610 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.176903 Sep 01 05:30:28.815474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 94/174] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:28 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:29.174190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:29.174913 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:29.181980 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.182556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.183229 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.183956 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.184488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.185101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.204869 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] HTTP exception thrown: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Request method failure captured: Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 HTTP/1.1 Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEMyojnh4re2hqXgqZ5_tKFLE6PGdewLx5MLwOCt3ymAInQHRCW0_IE--AVMvmoxNfhatBtJKo9J3UvKDZNH8STo5DeV8aRr83qONvAz6W8GGQjIxB7JnKgllUE8i1qjYLHAVRFj8HT0uT6zdHKTUvHcjNJobtUWks3dN7mBQnTlPrA Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: cc23f8d119514ad595637967b626e87d Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:29.212058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc23f8d119514ad595637967b626e87d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc23f8d119514ad595637967b626e87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc23f8d119514ad595637967b626e87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc23f8d119514ad595637967b626e87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: cc23f8d119514ad595637967b626e87d Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-DeleteServersTestJSON-1051584721-project Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 55c9d3a3577746a4ad7406fe4396eaee Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-DeleteServersTestJSON-1051584721-project Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.218751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '335b0b3d-5511-4399-b007-7431ea003409'} Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:29.220391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.221789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.223040 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Returning 404 to user: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:29.223040 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8789639e-192f-4ad1-b18a-784635197d0e tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 404 len: 111 microversion: 2.1 time: 0.044688 Sep 01 05:30:29.223040 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 81/175] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:29 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:29.279818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:29.281179 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:29.287667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.288144 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.288698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.289304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.289753 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.290164 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.357267 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:29.359846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:29.366206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.366726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.367146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.367829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.368442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.369018 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.384683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] HTTP exception thrown: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Request method failure captured: Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409/os-volume_attachments HTTP/1.1 Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEMyojnh4re2hqXgqZ5_tKFLE6PGdewLx5MLwOCt3ymAInQHRCW0_IE--AVMvmoxNfhatBtJKo9J3UvKDZNH8STo5DeV8aRr83qONvAz6W8GGQjIxB7JnKgllUE8i1qjYLHAVRFj8HT0uT6zdHKTUvHcjNJobtUWks3dN7mBQnTlPrA Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: cc23f8d119514ad595637967b626e87d Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:29.387076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc23f8d119514ad595637967b626e87d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc23f8d119514ad595637967b626e87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc23f8d119514ad595637967b626e87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc23f8d119514ad595637967b626e87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: cc23f8d119514ad595637967b626e87d Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-DeleteServersTestJSON-1051584721-project Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 55c9d3a3577746a4ad7406fe4396eaee Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-DeleteServersTestJSON-1051584721-project Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.388550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'server_id': '335b0b3d-5511-4399-b007-7431ea003409'} Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:29.389383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:29.392078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:29.393859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Returning 404 to user: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:29.393859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b55ba857-5d1f-4f7e-9a24-95876cc210d2 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036952 Sep 01 05:30:29.393859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 82/176] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:30:29 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:30:29.503402 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:29.515585 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-44960142-e0d6-4afb-a4b9-a95613edcf94 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.237499 Sep 01 05:30:29.521306 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 95/177] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:29 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:29.836258 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:29.836864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:29.842746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.843219 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.843646 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:29.844333 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:29.844779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:29.845192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.003798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:30.011887 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b2829eae-e97d-4bff-9bf1-a480ef659f52 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.179453 Sep 01 05:30:30.012947 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 83/178] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:29 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:30.533589 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:30.534146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:30.540013 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:30.540478 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:30.540899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.541631 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:30.542022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:30.542477 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.566342 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:30.682035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:30.689613 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-55230370-f25c-4c9d-aab5-238be63e31c8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.160477 Sep 01 05:30:30.692316 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 96/179] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:30 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:30.859639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:30.860118 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:30.866675 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:30.867109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:30.867539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.868217 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:30.868663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:30.869096 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.883290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] HTTP exception thrown: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Request method failure captured: Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 HTTP/1.1 Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEMyojnh4re2hqXgqZ5_tKFLE6PGdewLx5MLwOCt3ymAInQHRCW0_IE--AVMvmoxNfhatBtJKo9J3UvKDZNH8STo5DeV8aRr83qONvAz6W8GGQjIxB7JnKgllUE8i1qjYLHAVRFj8HT0uT6zdHKTUvHcjNJobtUWks3dN7mBQnTlPrA Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: cc23f8d119514ad595637967b626e87d Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:30.885410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc23f8d119514ad595637967b626e87d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc23f8d119514ad595637967b626e87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc23f8d119514ad595637967b626e87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc23f8d119514ad595637967b626e87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: cc23f8d119514ad595637967b626e87d Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-DeleteServersTestJSON-1051584721-project Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 55c9d3a3577746a4ad7406fe4396eaee Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-DeleteServersTestJSON-1051584721-project Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.886930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '335b0b3d-5511-4399-b007-7431ea003409'} Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:30.887738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.889690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.895334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Returning 404 to user: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:30.895334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0e569829-756b-4614-bfa5-6db92f520bd1 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "DELETE /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 404 len: 111 microversion: 2.1 time: 0.032278 Sep 01 05:30:30.895334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 84/180] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:30:30 2022] DELETE /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:30.900548 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:30.901801 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] [instance: 335b0b3d-5511-4399-b007-7431ea003409] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:30.910395 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:30.910395 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:30.910395 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.910395 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:30.910797 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:30.910797 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:30.924490 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] HTTP exception thrown: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Request method failure captured: Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 HTTP/1.1 Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEMyojnh4re2hqXgqZ5_tKFLE6PGdewLx5MLwOCt3ymAInQHRCW0_IE--AVMvmoxNfhatBtJKo9J3UvKDZNH8STo5DeV8aRr83qONvAz6W8GGQjIxB7JnKgllUE8i1qjYLHAVRFj8HT0uT6zdHKTUvHcjNJobtUWks3dN7mBQnTlPrA Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: cc23f8d119514ad595637967b626e87d Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:30:30.929266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cc23f8d119514ad595637967b626e87d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc23f8d119514ad595637967b626e87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cc23f8d119514ad595637967b626e87d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cc23f8d119514ad595637967b626e87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: cc23f8d119514ad595637967b626e87d Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-DeleteServersTestJSON-1051584721 Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-DeleteServersTestJSON-1051584721-project Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 55c9d3a3577746a4ad7406fe4396eaee Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-DeleteServersTestJSON-1051584721-project Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.930835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '335b0b3d-5511-4399-b007-7431ea003409'} Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:30.931642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. Sep 01 05:30:30.932945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:30.934153 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] Returning 404 to user: Instance 335b0b3d-5511-4399-b007-7431ea003409 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:30.934153 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b2b9faad-d5e8-44b1-9819-c57c35ac8975 tempest-DeleteServersTestJSON-1051584721 tempest-DeleteServersTestJSON-1051584721-project] 10.222.0.16 "GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409" status: 404 len: 111 microversion: 2.1 time: 0.034003 Sep 01 05:30:30.934153 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 97/181] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:30 2022] GET /compute/v2.1/servers/335b0b3d-5511-4399-b007-7431ea003409 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:31.033103 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:31.033945 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:31.040235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:31.040713 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:31.047660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:31.047660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:31.047660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:31.047660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:31.171485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:31.180342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f3c96033-250a-4abe-8e58-eb1c5cf340cf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.151176 Sep 01 05:30:31.181062 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 85/182] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:31 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:31.712926 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:31.713601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:31.719694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:31.721350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:31.722043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:31.722537 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:31.723297 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:31.723732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:31.724237 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:31.961124 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:31.973372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7b7270b8-7b3b-4339-ba89-458ae78dbb92 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.266558 Sep 01 05:30:31.974398 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 98/183] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:31 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:32.201330 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:32.201939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:32.210513 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:32.211211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:32.212695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:32.213682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:32.214429 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:32.215113 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:32.427374 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:32.434164 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-79692fde-13b2-41eb-b349-2d04524f9c49 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.236954 Sep 01 05:30:32.434938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 86/184] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:32 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:33.000194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:33.000194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:33.000194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=10 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:33.009520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:33.010008 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:33.014018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:33.014885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:33.015356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:33.015786 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:33.284403 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:33.293140 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d0628b4c-91ba-457c-b7a1-833f0c5dfdbf tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.302369 Sep 01 05:30:33.297715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 99/185] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:32 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:33.456759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:33.457355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:33.466307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:33.467777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:33.469123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:33.469851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:33.471142 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:33.471581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:33.646393 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:33.657254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7527fa82-fab8-4df9-b7f1-8e787a254841 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.204591 Sep 01 05:30:33.658726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 87/186] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:33 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:34.315242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:34.315968 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:34.325719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.326236 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.326688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.327383 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.327831 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.328247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.564242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:34.573007 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-137881ec-979b-4a05-9811-d0c2bc7daa47 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.262430 Sep 01 05:30:34.573507 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 100/187] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:34 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:34.676943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:34.677540 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:34.684200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.684563 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.685038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.685746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:34.686187 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:34.686859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:34.727401 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:34.988276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:34.998909 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1a4c82d1-0395-4f79-b1c2-103e6c6363a1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.325629 Sep 01 05:30:35.000615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 88/188] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:34 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:35.594428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:35.595678 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:35.602762 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:35.603533 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:35.603960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:35.605049 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:35.605678 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:35.607012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:35.756904 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:35.764762 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-58d975f0-6c87-4782-9f8c-d0fa353f87d5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.174313 Sep 01 05:30:35.765321 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 101/189] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:35 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:36.021718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:36.022437 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:36.030370 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.030882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.031318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.032004 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.032453 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.032875 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.166442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:36.174965 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-eefa010a-6371-4dfe-9963-1e3b1ee0da3d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.157196 Sep 01 05:30:36.175535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 89/190] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:36 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:36.480301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-c4981a46-dd48-45d1-b3a7-f7f4daf0e2ca req-ecb873d6-4f3b-4711-87bc-e50d63942e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a54e84d-9d5b-48b9-aee6-a73196cd4f27", "name": "network-vif-plugged", "status": "completed", "tag": "40a18e23-320e-4f3e-a3e1-2927d5dea00e"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:36.500963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c4981a46-dd48-45d1-b3a7-f7f4daf0e2ca req-ecb873d6-4f3b-4711-87bc-e50d63942e32 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.501444 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c4981a46-dd48-45d1-b3a7-f7f4daf0e2ca req-ecb873d6-4f3b-4711-87bc-e50d63942e32 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.502920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c4981a46-dd48-45d1-b3a7-f7f4daf0e2ca req-ecb873d6-4f3b-4711-87bc-e50d63942e32 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.526220 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-c4981a46-dd48-45d1-b3a7-f7f4daf0e2ca req-ecb873d6-4f3b-4711-87bc-e50d63942e32 service nova] Creating event network-vif-plugged:40a18e23-320e-4f3e-a3e1-2927d5dea00e for instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 on hv-cinder-83602 Sep 01 05:30:36.533205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-c4981a46-dd48-45d1-b3a7-f7f4daf0e2ca req-ecb873d6-4f3b-4711-87bc-e50d63942e32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058171 Sep 01 05:30:36.534554 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 102/191] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:36.785862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:36.786488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:36.792732 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.793206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.793602 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:36.794287 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:36.794756 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:36.795173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:37.011701 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:37.021714 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-611d69b4-59bc-4db9-a1fd-cb2dd72a4891 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.239596 Sep 01 05:30:37.026742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 90/192] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:36 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:37.200204 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:37.201232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:37.208858 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:37.209359 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:37.209783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:37.210508 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:37.210956 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:37.211377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:37.359960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:37.367587 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1de4ec5e-a0e5-41f8-8a84-4edd1dc9215c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.173101 Sep 01 05:30:37.368143 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 103/193] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:37 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:37.857608 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7461a17a-13ea-43a2-8e3b-145a8a2e620f tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Action: 'create', calling method: .version_select at 0x7f953b19c0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1246628200"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:38.041918 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:38.043441 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:38.049440 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.049945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.050640 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.051290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.054560 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.054560 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.207076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:38.215213 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-640a4bb7-b5f4-4851-8850-8be75320866f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1314 microversion: 2.1 time: 0.177294 Sep 01 05:30:38.216129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 104/194] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:38 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:38.395558 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:38.396181 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:38.402141 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.402669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.403106 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.403895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:38.404412 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:38.404895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:38.580286 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:38.593348 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f4216199-1263-4c3a-9ec5-ed3fe681b377 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.201507 Sep 01 05:30:38.594323 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 105/195] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:38 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:38.616316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7461a17a-13ea-43a2-8e3b-145a8a2e620f tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.877730 Sep 01 05:30:38.621769 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 91/196] 10.222.0.16 () {60 vars in 1155 bytes} [Thu Sep 1 05:30:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 880 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 05:30:38.635158 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8efca404-e69d-4344-894c-eea5a278a87c tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b1a23a0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:38.710795 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8efca404-e69d-4344-894c-eea5a278a87c tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e" status: 200 len: 345 microversion: 2.1 time: 0.079273 Sep 01 05:30:38.712161 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 106/197] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:38 2022] GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:39.238520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:39.239121 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:39.248962 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:39.249443 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:39.249871 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:39.250689 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:39.251133 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:39.251546 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:39.422753 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:39.432005 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cd0c925c-3d31-4e96-bdb5-326ecb297551 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1499 microversion: 2.1 time: 0.198494 Sep 01 05:30:39.435524 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 92/198] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:39 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1499 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:39.616938 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:39.617603 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:39.626628 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:39.628242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:39.628242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:39.628807 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:39.629253 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:39.639996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:39.728821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7c33da51-bb71-4daf-b616-48d3a14921b0 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b187b80>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:39.803377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:39.818862 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-988e57a5-5b6f-4597-8904-46179c4c77d9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.202453 Sep 01 05:30:39.818862 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 107/199] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:39 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:39.866008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7c33da51-bb71-4daf-b616-48d3a14921b0 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e" status: 200 len: 346 microversion: 2.1 time: 0.144001 Sep 01 05:30:39.869442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 93/200] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:39 2022] GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e => generated 346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:39.884278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8230f9ea-b600-4351-b29c-36061fc13e93 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Action: 'create', calling method: .version_select at 0x7f953b189940>, body: {"snapshot": {"volume_id": "6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1758120978"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:40.484556 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8230f9ea-b600-4351-b29c-36061fc13e93 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.608876 Sep 01 05:30:40.485686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 108/201] 10.222.0.16 () {60 vars in 1162 bytes} [Thu Sep 1 05:30:39 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:40.496872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-de1e8e90-33d1-4ff0-a778-38111bfa1de6 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b19ca60>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.624787 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.625382 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:40.639990 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.641707 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.641707 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:40.641889 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.642901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.643720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:40.660610 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-de1e8e90-33d1-4ff0-a778-38111bfa1de6 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 200 len: 287 microversion: 2.1 time: 0.167932 Sep 01 05:30:40.661690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 94/202] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:40.673243 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-392366c9-64c1-4f5d-a05c-89687e4a5ad6 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b28cee0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.687137 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:30:40.706482 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-392366c9-64c1-4f5d-a05c-89687e4a5ad6 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.038036 Sep 01 05:30:40.711303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 95/203] 10.222.0.16 () {58 vars in 1140 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:40.718723 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a8187b58-f387-4e6b-a7ea-1e599f8ccd12 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b19e0d0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.753276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a8187b58-f387-4e6b-a7ea-1e599f8ccd12 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 200 len: 287 microversion: 2.1 time: 0.038882 Sep 01 05:30:40.754703 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 96/204] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:40.838584 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:40.839177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:40.848060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.855250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.855250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:40.855250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:40.855250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:40.855652 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:41.005755 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:41.009695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6e41d6d5-b483-4fb7-8956-eab7dbcf2182 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.175988 Sep 01 05:30:41.010257 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 97/205] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:40 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:41.069390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-362224a8-adc7-4226-bd64-98e3431005cd tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 204 len: 0 microversion: 2.1 time: 0.449967 Sep 01 05:30:41.074287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 109/206] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:30:40 2022] DELETE /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:30:41.080509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:41.081114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:41.089132 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:41.089647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:41.090256 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:41.091077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:41.092062 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:41.092614 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:41.269164 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:41.276430 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cf390dd9-045a-4a55-99ad-419d0b593a3b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1505 microversion: 2.1 time: 0.200608 Sep 01 05:30:41.277005 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 98/207] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:41 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:41.767701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9f83ee7f-beca-44cd-ae47-1656f3b7f3b4 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b1a2b80>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:41.811067 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9f83ee7f-beca-44cd-ae47-1656f3b7f3b4 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 200 len: 287 microversion: 2.1 time: 0.039785 Sep 01 05:30:41.811067 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 110/208] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 05:30:41 2022] GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:42.030988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:42.031611 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:42.038603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.041519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.041519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.041519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.041519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.042036 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.180003 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:42.188521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4496cce0-9d69-462b-87f1-f15c2fc537b3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.162122 Sep 01 05:30:42.189349 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 99/209] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:42 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:42.297648 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:42.300464 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:42.305760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.306230 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.306680 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.307543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:42.308005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:42.308411 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:42.456713 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:42.468142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1cd88080-80ee-48ad-94b7-a76349a4c98c tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1505 microversion: 2.1 time: 0.174273 Sep 01 05:30:42.468827 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 111/210] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:42 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:42.815989 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-351cc11e-0ae7-438d-94a6-9b788486c431 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b13a3a0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:42.849188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-351cc11e-0ae7-438d-94a6-9b788486c431 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 200 len: 287 microversion: 2.1 time: 0.036708 Sep 01 05:30:42.850214 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 100/211] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 05:30:42 2022] GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:43.212090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.212694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:43.221925 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.222654 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.223083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.223765 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.224213 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.224621 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.361841 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:43.371145 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-368c811f-60a1-4186-9b0b-06ec0585ce53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.162865 Sep 01 05:30:43.371983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 112/212] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:43 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:43.489639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.490178 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:43.497877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.498337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.498788 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.508070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:43.508070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:43.508070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:43.651676 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:43.669666 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8bb744a3-2f3d-4cb0-800c-3aa5e2ec676e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1505 microversion: 2.1 time: 0.179499 Sep 01 05:30:43.669666 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 101/213] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:43 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1505 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:43.863216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-898e141c-41bd-4f5b-8c17-c9119683536d tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b1304c0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:43.900583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-898e141c-41bd-4f5b-8c17-c9119683536d tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 200 len: 287 microversion: 2.1 time: 0.041359 Sep 01 05:30:43.902668 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 113/214] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 05:30:43 2022] GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:44.405248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:44.405248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:44.405248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.405248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.405826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.405826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.405826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.405826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.593624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:44.603015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-be7cc638-ef29-4a73-a736-7a22e2cdf0c7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.213612 Sep 01 05:30:44.603620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 102/215] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:44 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:44.690163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:44.693653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:44.700723 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.709063 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.709516 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.713051 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:44.713746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:44.717480 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:44.915544 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-118e9268-2ef4-45cb-882e-b8c109cb9330 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b13aee0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:44.937660 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:44.958249 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-69493b65-49b0-439b-a29f-574ea6fd0e09 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1505 microversion: 2.1 time: 0.272018 Sep 01 05:30:44.961372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 114/216] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:44 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1505 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:45.135131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-118e9268-2ef4-45cb-882e-b8c109cb9330 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 200 len: 288 microversion: 2.1 time: 0.224903 Sep 01 05:30:45.135995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 103/217] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 05:30:44 2022] GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 288 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:45.158277 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2757b4d7-777f-49ac-bed0-f468de83bb3f tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b130040>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.259906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-47c68adb-aa96-48bd-9a66-65b3dd634d3f req-b45b07b0-984f-47a7-ba6d-87e72f6ed3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a54e84d-9d5b-48b9-aee6-a73196cd4f27", "name": "network-vif-deleted", "tag": "40a18e23-320e-4f3e-a3e1-2927d5dea00e"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:45.270940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-47c68adb-aa96-48bd-9a66-65b3dd634d3f req-b45b07b0-984f-47a7-ba6d-87e72f6ed3b4 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.271451 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-47c68adb-aa96-48bd-9a66-65b3dd634d3f req-b45b07b0-984f-47a7-ba6d-87e72f6ed3b4 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.271881 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-47c68adb-aa96-48bd-9a66-65b3dd634d3f req-b45b07b0-984f-47a7-ba6d-87e72f6ed3b4 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.285203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-47c68adb-aa96-48bd-9a66-65b3dd634d3f req-b45b07b0-984f-47a7-ba6d-87e72f6ed3b4 service nova] Creating event network-vif-deleted:40a18e23-320e-4f3e-a3e1-2927d5dea00e for instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 on hv-cinder-83602 Sep 01 05:30:45.290816 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-47c68adb-aa96-48bd-9a66-65b3dd634d3f req-b45b07b0-984f-47a7-ba6d-87e72f6ed3b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034506 Sep 01 05:30:45.291424 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 104/218] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:45.430044 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2757b4d7-777f-49ac-bed0-f468de83bb3f tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 202 len: 0 microversion: 2.1 time: 0.280094 Sep 01 05:30:45.434263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 115/219] 10.222.0.16 () {58 vars in 1254 bytes} [Thu Sep 1 05:30:45 2022] DELETE /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:30:45.443981 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1f2875fb-476e-4169-aabc-bf6514aca1ff tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b133e50>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.479781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1f2875fb-476e-4169-aabc-bf6514aca1ff tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 200 len: 287 microversion: 2.1 time: 0.039962 Sep 01 05:30:45.480401 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 105/220] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 05:30:45 2022] GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:45.624940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.625545 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:45.640836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.640836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.640836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.640836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.641207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.641207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.798320 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:45.806992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-182f8c77-fa63-47bb-bfcc-3aa4474ea9aa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.186243 Sep 01 05:30:45.807743 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 116/221] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:45 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:45.984676 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:45.988064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:45.995104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:45.998076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:45.998748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:45.999650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:46.000251 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:46.000846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.041144 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:46.041793 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:46.042275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.042846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lazy-loading 'fault' on Instance uuid 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:30:46.099463 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:46.115877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9c946ce6-7400-49fc-a3c6-301007298b29 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1304 microversion: 2.1 time: 0.136114 Sep 01 05:30:46.117967 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 106/222] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:45 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:46.492688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-18b90a7c-8bf9-46ba-af04-3e4b72ed0d0d tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b130160>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:46.532904 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-18b90a7c-8bf9-46ba-af04-3e4b72ed0d0d tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] HTTP exception thrown: Snapshot 176676c1-02fb-4267-b9db-a50e07c27fbd could not be found. Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-18b90a7c-8bf9-46ba-af04-3e4b72ed0d0d tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Request method failure captured: Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd HTTP/1.1 Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEN9M7hY7aQxCctEearDUTJ-pHnLc_PYxk61yq7Lsv2WBwdL36SseLCsQ6mJHvKj3Y-xYVQGYuWmnRPqa2SEiZEFk8s2Ies1w4T1LjpZyRRQOA8JN6GVrRPNppv1Eom6rvyM8uFfic74fH94HKoBipgs8V4U0OMv7ZPkmX6PeGisrUs Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: cad65f0671c74411a13bc1d12229e8f9 Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:30:46.535287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: cad65f0671c74411a13bc1d12229e8f9 Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesSnapshotsTestJSON-1163773662-project Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: bb6e38cb0019468ba7bb0962af5b5445 Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1163773662-project Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Snapshot 176676c1-02fb-4267-b9db-a50e07c27fbd could not be found. Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '176676c1-02fb-4267-b9db-a50e07c27fbd'} Sep 01 05:30:46.536822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 176676c1-02fb-4267-b9db-a50e07c27fbd could not be found. (HTTP 404) (Request-ID: req-dea51bd9-0d5e-41d9-a8d2-ed8648451d63) Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:46.537829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:46.539099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 176676c1-02fb-4267-b9db-a50e07c27fbd could not be found. Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 05:30:46.540462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 176676c1-02fb-4267-b9db-a50e07c27fbd could not be found. Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 176676c1-02fb-4267-b9db-a50e07c27fbd could not be found. Sep 01 05:30:46.541895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:46.543720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-18b90a7c-8bf9-46ba-af04-3e4b72ed0d0d tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Returning 404 to user: Snapshot 176676c1-02fb-4267-b9db-a50e07c27fbd could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:46.544572 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-18b90a7c-8bf9-46ba-af04-3e4b72ed0d0d tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd" status: 404 len: 111 microversion: 2.1 time: 0.056209 Sep 01 05:30:46.548537 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 117/223] 10.222.0.16 () {58 vars in 1251 bytes} [Thu Sep 1 05:30:46 2022] GET /compute/v2.1/os-snapshots/176676c1-02fb-4267-b9db-a50e07c27fbd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:46.556784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1ac99dce-6f08-44b9-89c0-0f736ad33190 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b133e50>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:46.839339 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:46.840130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:46.859492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:46.862400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:46.862845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.871117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1ac99dce-6f08-44b9-89c0-0f736ad33190 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e" status: 202 len: 0 microversion: 2.1 time: 0.312774 Sep 01 05:30:46.871117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 107/224] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:30:46 2022] DELETE /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:30:46.871698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:46.871698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:46.871698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:46.874134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-19492bb9-51ef-4f31-a991-4375a23235f1 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b13a160>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:46.944861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-19492bb9-51ef-4f31-a991-4375a23235f1 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e" status: 200 len: 345 microversion: 2.1 time: 0.075167 Sep 01 05:30:46.945446 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 108/225] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:46 2022] GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:30:47.033745 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:47.037445 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:47.042055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ebbcfe98-716c-401f-9087-761d396197ff tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.214139 Sep 01 05:30:47.042643 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 118/226] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:46 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:47.138615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:47.143029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:47.160509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.162296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.162296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.162296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.163075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.163499 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.247748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:47.248527 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:47.249251 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:47.249689 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lazy-loading 'fault' on Instance uuid 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:30:47.312104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:47.327398 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-03f9cd4f-0921-4986-a3fc-4b42dbd8a4a5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 200 len: 1304 microversion: 2.1 time: 0.193642 Sep 01 05:30:47.328730 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 109/227] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:47 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 1304 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:47.962862 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-13f39ba2-80ff-4e67-adb5-c8f6aba61487 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b130ee0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:48.005239 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-13f39ba2-80ff-4e67-adb5-c8f6aba61487 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] HTTP exception thrown: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-13f39ba2-80ff-4e67-adb5-c8f6aba61487 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Request method failure captured: Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e HTTP/1.1 Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEN9M7hY7aQxCctEearDUTJ-pHnLc_PYxk61yq7Lsv2WBwdL36SseLCsQ6mJHvKj3Y-xYVQGYuWmnRPqa2SEiZEFk8s2Ies1w4T1LjpZyRRQOA8JN6GVrRPNppv1Eom6rvyM8uFfic74fH94HKoBipgs8V4U0OMv7ZPkmX6PeGisrUs Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: cad65f0671c74411a13bc1d12229e8f9 Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:30:48.007920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: cad65f0671c74411a13bc1d12229e8f9 Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesSnapshotsTestJSON-1163773662-project Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: bb6e38cb0019468ba7bb0962af5b5445 Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1163773662-project Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e'} Sep 01 05:30:48.009356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. (HTTP 404) (Request-ID: req-68136623-df08-457a-8b6b-6ebb379f037a) Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.010221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:48.011322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:30:48.012313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-13f39ba2-80ff-4e67-adb5-c8f6aba61487 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Returning 404 to user: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-13f39ba2-80ff-4e67-adb5-c8f6aba61487 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e" status: 404 len: 109 microversion: 2.1 time: 0.056998 Sep 01 05:30:48.015195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 119/228] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:47 2022] GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:48.027111 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b3615886-5eb7-469a-9542-4d5f2fdbfe42 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b133dc0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:48.067520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:48.068119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:48.078174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-b3615886-5eb7-469a-9542-4d5f2fdbfe42 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] HTTP exception thrown: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b3615886-5eb7-469a-9542-4d5f2fdbfe42 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Request method failure captured: Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e HTTP/1.1 Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN9M7hY7aQxCctEearDUTJ-pHnLc_PYxk61yq7Lsv2WBwdL36SseLCsQ6mJHvKj3Y-xYVQGYuWmnRPqa2SEiZEFk8s2Ies1w4T1LjpZyRRQOA8JN6GVrRPNppv1Eom6rvyM8uFfic74fH94HKoBipgs8V4U0OMv7ZPkmX6PeGisrUs Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: cad65f0671c74411a13bc1d12229e8f9 Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:48.082170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: cad65f0671c74411a13bc1d12229e8f9 Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesSnapshotsTestJSON-1163773662-project Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: bb6e38cb0019468ba7bb0962af5b5445 Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1163773662-project Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e'} Sep 01 05:30:48.083384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. (HTTP 404) (Request-ID: req-2bba3ae0-6ac9-49cd-9563-6c9a3abdc779) Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.084122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 05:30:48.085116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 05:30:48.086115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b3615886-5eb7-469a-9542-4d5f2fdbfe42 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Returning 404 to user: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b3615886-5eb7-469a-9542-4d5f2fdbfe42 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e" status: 404 len: 109 microversion: 2.1 time: 0.060031 Sep 01 05:30:48.088290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 110/229] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:30:48 2022] DELETE /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:48.092378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:48.092884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:48.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:48.097803 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:48.097943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c4bbd8f0-2436-4e3b-9ae0-94dc35397193 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Calling method '.version_select at 0x7f953b12e280>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:48.098304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:48.098775 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:48.133617 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-c4bbd8f0-2436-4e3b-9ae0-94dc35397193 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] HTTP exception thrown: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c4bbd8f0-2436-4e3b-9ae0-94dc35397193 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Request method failure captured: Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e HTTP/1.1 Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEN9M7hY7aQxCctEearDUTJ-pHnLc_PYxk61yq7Lsv2WBwdL36SseLCsQ6mJHvKj3Y-xYVQGYuWmnRPqa2SEiZEFk8s2Ies1w4T1LjpZyRRQOA8JN6GVrRPNppv1Eom6rvyM8uFfic74fH94HKoBipgs8V4U0OMv7ZPkmX6PeGisrUs Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: cad65f0671c74411a13bc1d12229e8f9 Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:48.135575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cad65f0671c74411a13bc1d12229e8f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: cad65f0671c74411a13bc1d12229e8f9 Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1163773662 Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesSnapshotsTestJSON-1163773662-project Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: bb6e38cb0019468ba7bb0962af5b5445 Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1163773662-project Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e'} Sep 01 05:30:48.143354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. (HTTP 404) (Request-ID: req-b6fee137-e5e7-4641-8ee6-d78c1ea6b321) Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.144537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 05:30:48.145591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 05:30:48.146784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c4bbd8f0-2436-4e3b-9ae0-94dc35397193 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] Returning 404 to user: Volume 6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c4bbd8f0-2436-4e3b-9ae0-94dc35397193 tempest-VolumesSnapshotsTestJSON-1163773662 tempest-VolumesSnapshotsTestJSON-1163773662-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e" status: 404 len: 109 microversion: 2.1 time: 0.049826 Sep 01 05:30:48.149633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 111/230] 10.222.0.16 () {58 vars in 1245 bytes} [Thu Sep 1 05:30:48 2022] GET /compute/v2.1/os-volumes/6de9e3dc-fc6e-44e4-8eef-f7d84515cb2e => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:48.311968 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:48.321136 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3781ced9-c9b2-40fc-95e1-9b3c0cf1a72b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1522 microversion: 2.1 time: 0.257447 Sep 01 05:30:48.323333 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 120/231] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:48 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:48.350426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:48.351322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 7a54e84d-9d5b-48b9-aee6-a73196cd4f27] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:48.359595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:48.360374 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:48.361017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:48.361881 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:48.362685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:48.363282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:48.379944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] HTTP exception thrown: Instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 could not be found. Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Request method failure captured: Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 HTTP/1.1 Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEENqzBF6OaVIPtibPmb8UcCoHaTT4l0__q4Rr02RfZOR4YFHYfBnyLbMP4SNvrK29SqKmXixKHnSBEfZKp_iAYofXA9j17onsr7pBw-lhnWBZo0jrB_BW1M4u9Lk5esOB8hmnhRzctN3J-fqVADnpqfS70ytPbk9pMNj09icFY-5adI Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1297d0249cf34d7290e867124be62377 Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesActionsTest-170987217 Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:30:48.381833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1297d0249cf34d7290e867124be62377"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1297d0249cf34d7290e867124be62377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1297d0249cf34d7290e867124be62377"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1297d0249cf34d7290e867124be62377"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesActionsTest-170987217 Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1297d0249cf34d7290e867124be62377 Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesActionsTest-170987217 Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesActionsTest-170987217-project Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 881062ec3efc4445a43e1ff772b09153 Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesActionsTest-170987217-project Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 could not be found. Sep 01 05:30:48.383340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '7a54e84d-9d5b-48b9-aee6-a73196cd4f27'} Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 could not be found. Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:30:48.384237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 could not be found. Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 could not be found. Sep 01 05:30:48.385522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:30:48.387408 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Returning 404 to user: Instance 7a54e84d-9d5b-48b9-aee6-a73196cd4f27 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:30:48.387408 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b3bf932c-9594-4e33-bed3-04005d158d00 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27" status: 404 len: 111 microversion: 2.1 time: 0.040014 Sep 01 05:30:48.387408 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 112/232] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:48 2022] GET /compute/v2.1/servers/7a54e84d-9d5b-48b9-aee6-a73196cd4f27 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:30:48.520147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-802019744", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "networks": [{"uuid": "232bad13-3140-4ff0-ab8b-8fdeb42cf55f"}]}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:48.577838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] validate_networks() for [('232bad13-3140-4ff0-ab8b-8fdeb42cf55f', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:30:49.180620 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:30:49.181820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:30:49.182575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:30:49.183219 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:30:49.183847 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:30:49.206027 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.207055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.207697 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.208656 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.209340 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.209861 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.227136 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Getting quotas for project 1297d0249cf34d7290e867124be62377. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:30:49.232902 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Getting quotas for user 881062ec3efc4445a43e1ff772b09153 and project 1297d0249cf34d7290e867124be62377. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:30:49.245673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:30:49.249348 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:30:49.349351 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.351313 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:49.365222 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.366528 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.367622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.369121 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.370998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.371428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.420639 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fd72545f-7a6a-4073-8fa3-d227c760d8ab tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904067 Sep 01 05:30:49.421925 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 121/233] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:30:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:30:49.433853 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9bedca35-4022-492d-a490-e5848d19d466 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.435098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9bedca35-4022-492d-a490-e5848d19d466 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:49.504770 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9bedca35-4022-492d-a490-e5848d19d466 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:49.512762 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9bedca35-4022-492d-a490-e5848d19d466 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1213 microversion: 2.1 time: 0.084069 Sep 01 05:30:49.513877 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 122/234] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:49.641818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:49.650307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-907ef951-9b2b-40e5-9583-2525329d2c1d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1502 microversion: 2.1 time: 0.309813 Sep 01 05:30:49.650913 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 113/235] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1502 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:49.672540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:49.673761 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:49.680598 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.681527 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.683048 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.684110 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:49.684866 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:49.685568 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:49.842180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:49.851134 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cb710682-876d-4dcc-b644-58b05a245589 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1515 microversion: 2.1 time: 0.183870 Sep 01 05:30:49.851698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 123/236] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:49 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:50.533344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:50.533973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:50.540198 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.540710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.541134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.541800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:50.542242 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:50.542673 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:50.641330 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:50.674138 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-41ea72f7-cb22-4146-94da-847d52690dc4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1217 microversion: 2.1 time: 0.131446 Sep 01 05:30:50.674138 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 114/237] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:50 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1217 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:51.694333 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:51.695099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:51.701462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.701959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.702390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.703123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.703571 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.704248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.779517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:51.792307 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4bacad15-e742-4d65-ab9b-1e459bb26d10 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1265 microversion: 2.1 time: 0.102968 Sep 01 05:30:51.793410 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 124/238] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:51 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:51.939550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:51.941837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:51.948304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.948778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.949200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.950097 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:51.950640 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:51.951283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:51.975908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'flavor' on Instance uuid e85c8e8e-97e2-4132-a090-67148112e3e2 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:30:52.260721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:52.343787 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e526ab6b-67fb-4453-b364-fb949ada4d9b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2/action" status: 200 len: 32 microversion: 2.1 time: 0.407417 Sep 01 05:30:52.355708 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:52.356329 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:52.359126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 115/239] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:30:51 2022] POST /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2/action => generated 32 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:30:52.362372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.363082 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.363837 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.364831 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.365720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.366389 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.562604 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:52.572748 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-123eb41f-b79d-473d-8308-5cc2211044f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.222013 Sep 01 05:30:52.573731 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 125/240] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:52 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:52.823341 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:52.824280 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:52.845603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=74 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:52.855481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.855481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.855481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:52.855481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:52.857996 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:52.858646 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:53.065261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:53.077438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-43fa666d-0e69-4ff6-a8bc-2a7257e1916a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1271 microversion: 2.1 time: 0.260354 Sep 01 05:30:53.083480 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 116/241] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:52 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1271 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:53.597863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:53.601038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:53.602180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:53.606568 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:53.607779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:53.608636 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:53.609797 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:53.610647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:53.611220 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:53.773904 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:53.782282 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-19c2fbb1-45f0-45c4-81d2-9acf52bd7e5a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.188348 Sep 01 05:30:53.782896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 126/242] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:53 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:54.100504 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:54.101111 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:54.108376 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.108853 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.109324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.110191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.110695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.111114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.253945 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:54.261512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-70257880-ad49-4c03-b66e-dc74d74c33c0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.165781 Sep 01 05:30:54.262067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 117/243] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:54 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:54.339096 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-ae9a4371-7bb8-4143-be0b-1f557558199d req-91755fc8-93d8-4b39-8cee-fcc2073ec5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a4aa9f-d25b-445f-930d-b79ee132ec6b", "tag": "dcfb942d-1ba7-452b-a2e8-93d3e7c7cabc"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:30:54.351680 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ae9a4371-7bb8-4143-be0b-1f557558199d req-91755fc8-93d8-4b39-8cee-fcc2073ec5d0 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.352263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ae9a4371-7bb8-4143-be0b-1f557558199d req-91755fc8-93d8-4b39-8cee-fcc2073ec5d0 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.352957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ae9a4371-7bb8-4143-be0b-1f557558199d req-91755fc8-93d8-4b39-8cee-fcc2073ec5d0 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.365846 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-ae9a4371-7bb8-4143-be0b-1f557558199d req-91755fc8-93d8-4b39-8cee-fcc2073ec5d0 service nova] Creating event network-changed:dcfb942d-1ba7-452b-a2e8-93d3e7c7cabc for instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b on hv-cinder-83602 Sep 01 05:30:54.371705 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-ae9a4371-7bb8-4143-be0b-1f557558199d req-91755fc8-93d8-4b39-8cee-fcc2073ec5d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036683 Sep 01 05:30:54.372553 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 127/244] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:30:54.803569 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:54.804168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:54.811195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.811717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.812140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.812865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:54.813303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:54.813724 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:54.944226 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:54.952424 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-37aff2ea-4879-47da-9ef9-5169b18fb629 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.153286 Sep 01 05:30:54.952978 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 118/245] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:54 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:55.283444 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:55.284281 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:55.291088 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:55.291846 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:55.292072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:55.292761 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:55.293205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:55.293617 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:55.425686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:55.433299 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9e02e9cf-cc45-4b46-949c-edac43f8137d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.154186 Sep 01 05:30:55.433895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 128/246] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:55 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:55.973415 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:55.973946 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:55.980318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:55.980790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:55.981219 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:55.981969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:55.982436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:55.982882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:56.105724 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:56.113309 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3a168044-bc45-461c-b035-1e5d901935d3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.143766 Sep 01 05:30:56.113868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 119/247] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:55 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:56.455664 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:56.456298 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:56.462212 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:56.462719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:56.463243 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:56.463955 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:56.464408 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:56.464826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:56.605882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:56.614098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5da0d663-18ce-44c3-8b4e-59dcdb049d71 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.163238 Sep 01 05:30:56.614724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 129/248] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:56 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:57.133196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:57.133794 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:57.140154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:57.140625 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:57.141050 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:57.141741 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:57.142167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:57.142616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:57.265181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:57.272890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-57fdbd83-f83e-4679-b514-dcbb48d7543e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.143661 Sep 01 05:30:57.273447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 120/249] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:57 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:57.634074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:57.635508 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:57.643480 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:57.644038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:57.644475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:57.645165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:57.645719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:57.646196 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:57.780892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:57.788570 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-759b6ea1-e81c-4adf-8c02-9766f7dbe056 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.158276 Sep 01 05:30:57.789122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 130/250] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:57 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:58.294158 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:58.294825 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:58.301235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.301707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.302135 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.302846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.303289 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.303706 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.428332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:58.435856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-647c64d5-1c5f-49db-84e9-c185f80eaa97 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.145519 Sep 01 05:30:58.436417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 121/251] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:58 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:58.808948 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:58.809491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:58.815958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.816517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.816948 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.817630 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:58.818080 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:58.818523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:58.947735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:58.956126 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-85caf3e5-b056-473b-a25a-bac0f2d53bb5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.151043 Sep 01 05:30:58.956690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 131/252] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:58 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:30:59.458043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:59.458695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:59.465093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:59.465565 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:59.466033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:59.466794 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:59.467239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:59.467655 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:59.849851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:30:59.858105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-416cd80d-1453-4b6d-9035-a966ef963153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.404056 Sep 01 05:30:59.858910 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 122/253] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:59 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:30:59.976692 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:30:59.977264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:30:59.979165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:59.980107 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=8 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:30:59.985417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:59.985940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:59.986458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:30:59.987152 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:30:59.987598 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:30:59.988018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.118232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:00.125922 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e54225c1-23f0-48bc-9c42-99297a77539e tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.153329 Sep 01 05:31:00.126537 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 132/254] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:30:59 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:00.879628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:00.880638 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:00.887168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.887580 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.888711 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:00.889379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:00.889821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:00.890232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.018045 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:01.025964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f9f0f527-f0e1-40f1-85f3-f039ef88ac38 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.150487 Sep 01 05:31:01.030535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 123/255] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:00 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:01.148783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:01.148783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:01.154797 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.155261 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.155685 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.156463 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:01.156861 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:01.157357 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:01.299311 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:01.306931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0334941c-20b2-4d06-9b4f-65600c4741f7 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.163413 Sep 01 05:31:01.307495 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 133/256] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:01 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:02.047248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:02.061220 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:02.061220 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.061220 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.061220 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.061632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.061632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.061632 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.196948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:02.205670 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a2a08312-f547-4f01-afed-c2d74d87916d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.162226 Sep 01 05:31:02.206236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 124/257] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:02 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:02.328918 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:02.329512 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:02.335380 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.335842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.336264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.336929 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:02.337369 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:02.337776 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:02.467053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:02.475036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-bf57bdb4-e7e5-4de8-b135-4f45bbd73d96 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.150841 Sep 01 05:31:02.475598 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 134/258] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:02 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:03.230831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:03.230831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:03.235631 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:03.236160 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:03.247862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:03.247862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:03.247862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:03.247862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:03.365881 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:03.373547 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-90771bc7-f4e2-4b38-a275-1e964353fcc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.150208 Sep 01 05:31:03.374102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 125/259] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:03 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:03.495112 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:03.499932 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:03.501583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:03.502053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:03.502502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:03.503173 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:03.503785 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:03.504011 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:03.634420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:03.643009 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7b6c7fb1-39ba-4b51-ad83-581b3719ffa0 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.151702 Sep 01 05:31:03.643580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 135/260] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:03 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:04.394764 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:04.395390 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:04.401895 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.402396 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.402807 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.403477 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.403915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.404331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.537664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:04.546186 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-26714f1a-df1c-4deb-9cf1-719f5fba3a6e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.155168 Sep 01 05:31:04.546778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 126/261] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:04 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:04.663694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:04.666605 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:04.670851 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.671312 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.671742 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.672424 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:04.672869 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:04.673400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:04.798706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:04.806161 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5a67f592-fd51-4e38-80ba-e5dd745fea01 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.146308 Sep 01 05:31:04.806753 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 136/262] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:04 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:05.567482 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:05.568085 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:05.574438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:05.574909 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:05.575336 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:05.576010 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:05.577086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:05.577507 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:05.704299 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:05.712120 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d223a8f7-0b1b-4c1f-b6f0-335e7952fecf tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.148454 Sep 01 05:31:05.712683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 127/263] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:05 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:05.826535 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:05.827070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:05.833301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:05.833775 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:05.834205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:05.834910 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:05.835360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:05.835809 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:05.959283 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:05.966775 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-456c4168-b7e9-411e-86e3-548168551353 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.144223 Sep 01 05:31:05.967342 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 137/264] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:05 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:06.733264 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:06.733842 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:06.739934 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:06.740421 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:06.740848 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:06.741513 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:06.741953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:06.742364 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:06.799594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:06.800202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:06.806955 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:06.807534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:06.811167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:06.811167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:06.811167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:06.811167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:06.834792 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fc7bcac8-a2f0-4a2a-a8f0-5f43211f938b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/ips" status: 200 len: 151 microversion: 2.20 time: 0.039276 Sep 01 05:31:06.850449 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 138/265] 10.222.0.16 () {60 vars in 1289 bytes} [Thu Sep 1 05:31:06 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:31:06.881011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:06.893096 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7e2949af-dabe-4210-a7ff-796be0e6267c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.163770 Sep 01 05:31:06.893938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 128/266] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:06 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:06.986375 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:06.986921 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:06.992769 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:06.993245 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:06.993673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:06.994355 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:06.994834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:06.995251 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:06.999939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:07.130620 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:07.138084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e5f41d43-b117-4b56-a45d-3c93aa72b131 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.155766 Sep 01 05:31:07.138675 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 139/267] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:06 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:07.914647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:07.915546 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:07.924180 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.925061 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.925508 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.926468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.927083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.927536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.959465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-8294956f-1103-498f-9caf-1e0f0e03bed9 req-fdca7c07-3495-49ba-aacb-098d9719807b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a4aa9f-d25b-445f-930d-b79ee132ec6b", "name": "network-vif-plugged", "status": "completed", "tag": "dcfb942d-1ba7-452b-a2e8-93d3e7c7cabc"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:07.972121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8294956f-1103-498f-9caf-1e0f0e03bed9 req-fdca7c07-3495-49ba-aacb-098d9719807b service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:07.972121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8294956f-1103-498f-9caf-1e0f0e03bed9 req-fdca7c07-3495-49ba-aacb-098d9719807b service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:07.972121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8294956f-1103-498f-9caf-1e0f0e03bed9 req-fdca7c07-3495-49ba-aacb-098d9719807b service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:07.983455 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-8294956f-1103-498f-9caf-1e0f0e03bed9 req-fdca7c07-3495-49ba-aacb-098d9719807b service nova] Creating event network-vif-plugged:dcfb942d-1ba7-452b-a2e8-93d3e7c7cabc for instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b on hv-cinder-83602 Sep 01 05:31:07.989646 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-8294956f-1103-498f-9caf-1e0f0e03bed9 req-fdca7c07-3495-49ba-aacb-098d9719807b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Sep 01 05:31:07.990243 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 140/268] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:31:08.084895 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:08.102697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bad3e212-bd01-471a-a9ad-f6df93cc5fd0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.185353 Sep 01 05:31:08.102697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 129/269] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:07 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:08.159408 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:08.160103 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:08.166208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:08.166776 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:08.167144 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:08.167868 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:08.168314 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:08.168731 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:08.304428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:08.312403 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3dc80845-d0a4-47c6-890c-9827d8ed58b2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.157152 Sep 01 05:31:08.318231 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 141/270] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:08 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:09.121156 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:09.122399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:09.129483 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.129966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.130397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.131307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.131756 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.132177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.293273 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:09.299743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6cab8d2d-e27a-4c4a-bf7e-e52e1a6b275d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.184467 Sep 01 05:31:09.300322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 130/271] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:09 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:09.333880 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:09.334629 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:09.341159 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.341736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.342263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.343041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:09.343665 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:09.344114 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:09.522920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:09.533150 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-69930517-a84f-4d70-bcf5-5f9a1c44dd4a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1313 microversion: 2.1 time: 0.203283 Sep 01 05:31:09.547070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 142/272] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:09 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:10.033882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:10.034435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:10.040763 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.041244 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.041738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.042732 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.043391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.043844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.068333 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lazy-loading 'flavor' on Instance uuid 4659e047-b384-4220-b0d3-26e9f67354c5 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:31:10.137353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:10.321651 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:10.322393 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:10.329349 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.329950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.330641 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.331557 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.332193 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.332680 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.490242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.498445 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-68a5f00f-3a0a-4695-8b6a-4ebe43a3bc53 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.180821 Sep 01 05:31:10.499016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 143/273] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:10 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:10.571881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:10.577944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:10.585718 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.586492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.586947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.587633 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.588074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.588484 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.664778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f46b80be-684c-413d-a922-b08ef0cbb766 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/action" status: 202 len: 0 microversion: 2.20 time: 0.634987 Sep 01 05:31:10.666371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 131/274] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 1 05:31:10 2022] POST /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:31:10.694216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:10.695325 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:10.703346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.704552 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.705039 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.705790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:10.706300 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:10.706742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:10.798832 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.811666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5b6c77bc-cf9b-4914-99ef-109f6cd1c47a tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1497 microversion: 2.1 time: 0.247382 Sep 01 05:31:10.813645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 144/275] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:10 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1497 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:10.873006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.883118 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.884499 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:10.885715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-172db0eb-d078-456b-9632-e191ea51564f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.213482 Sep 01 05:31:10.886259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 132/276] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:10 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:11.523110 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:11.524201 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:11.530825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.532150 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.532663 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.534310 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.534865 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.535372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.716479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:11.725114 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9972bf7a-a7db-40ed-b5be-ca5d68d86bc9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.208006 Sep 01 05:31:11.725684 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 145/277] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:11 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:11.900721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:11.901218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:11.908489 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.908967 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.909323 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:11.909493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.910808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.910951 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:11.911105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.911105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.917754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.918237 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.921611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.921611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:11.921611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:11.921611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:11.936776 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:31:12.059173 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.070456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.071947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.073189 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-20e0a858-11da-424f-9c14-bcf0d3f891c1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.168188 Sep 01 05:31:12.073736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 146/278] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:11 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:12.227551 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5ea9f1c4-78c3-4949-9699-b977ecd7fe46 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 204 len: 0 microversion: 2.1 time: 0.330098 Sep 01 05:31:12.228312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 133/279] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:31:11 2022] DELETE /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:31:12.236917 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:12.237843 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:12.244474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.244946 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.245482 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.251252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.251252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.251252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.397402 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.405600 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-282705cf-03b2-4cb7-bbb0-8a3bed8916dc tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1503 microversion: 2.1 time: 0.172574 Sep 01 05:31:12.406180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 147/280] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:12 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:12.747593 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:12.748314 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:12.754178 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.754666 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.756304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.756304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:12.756304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:12.756662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:12.900541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:12.908892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8562c6fd-77a8-4822-b411-6746bd960567 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.166220 Sep 01 05:31:12.909453 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 134/281] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:12 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:13.100994 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:13.101581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:13.107385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.107863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.108291 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.108969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.109413 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.110391 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.241596 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.249561 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.251084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.252240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3800f511-25b2-43a2-aaf9-f9d039f22c5d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.155156 Sep 01 05:31:13.252778 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 148/282] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:13 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:13.427822 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:13.428456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:13.435226 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.435704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.436127 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.437233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.437823 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.438245 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.612167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:13.620540 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-590f4c58-686b-4093-bb59-cc3618ab40b8 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1503 microversion: 2.1 time: 0.197538 Sep 01 05:31:13.621808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 135/283] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:13 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:13.934253 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:13.934882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:13.942819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.943300 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.943734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:13.944428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:13.944874 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:13.945292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.096253 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.105424 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-449844b1-839a-458e-93f1-af8cd2e5424d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.174979 Sep 01 05:31:14.106694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 149/284] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:13 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:14.283141 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:14.283865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:14.290658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.291217 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.291722 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.292494 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.293210 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.293675 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.435773 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.445904 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.446021 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.447154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-20439bec-f335-4352-8ab5-dfc3a951d404 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.169793 Sep 01 05:31:14.447712 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 136/285] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:14 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:14.642727 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:14.643320 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:14.649529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.649989 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.650433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.651092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:14.651531 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:14.651940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:14.789218 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:14.797086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9a349c99-2c39-4e3a-be90-357e13b16627 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1503 microversion: 2.1 time: 0.158876 Sep 01 05:31:14.797730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 150/286] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:14 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:15.127021 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:15.127621 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:15.133381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.133846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.134288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.134953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.135392 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.135804 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.276411 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:15.284412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-55c96a53-1617-47cc-b024-5538d6ca3b16 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.161717 Sep 01 05:31:15.284981 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 137/287] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:15 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:15.469982 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:15.470618 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:15.476435 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.476905 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.477326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.477993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.478452 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.478870 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.606539 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:15.615023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:15.616737 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:15.617871 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7abc2c12-ced4-440a-8a93-c72ec3dbde31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.152077 Sep 01 05:31:15.618442 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 151/288] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:15 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:15.817499 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:15.818098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:15.824811 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.825251 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.825634 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.826303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:15.826770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:15.827229 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:15.969253 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:15.977130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-703b1a44-a245-4880-b4fd-a30f31fb4ef2 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1503 microversion: 2.1 time: 0.163482 Sep 01 05:31:15.977683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 138/289] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:15 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:16.305257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:16.305858 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:16.311937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.312413 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.313416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:16.314090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.314690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.315108 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:16.473284 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.481246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-627b3322-b4cf-46a6-ae1f-87c3344b174d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.179867 Sep 01 05:31:16.481833 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 152/290] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:16 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:16.641066 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:16.641662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:16.647942 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.648424 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.648833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:16.649513 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:16.650035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:16.650442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:16.791311 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.794145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.795854 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:16.797575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-24c83eb7-017a-4cc0-b4bb-bb691b349d17 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.159842 Sep 01 05:31:16.798127 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 139/291] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:16 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:16.997285 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:16.997893 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:17.009093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.009093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.009093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.009093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.009509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.009509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.134776 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.142988 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7ac82569-dcb5-4b38-a78b-38ec747795e5 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1503 microversion: 2.1 time: 0.149497 Sep 01 05:31:17.143534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 153/292] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:16 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:17.498193 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:17.499426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:17.503229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:17.503824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:17.505962 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.506976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.506976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.507585 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.508028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.508444 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.509476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.509949 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.510396 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.511091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.511530 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.511943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.532127 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b99ce59a-dd41-4b88-977c-4328ef3d7e5e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/ips" status: 200 len: 149 microversion: 2.1 time: 0.037116 Sep 01 05:31:17.541655 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 140/293] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:31:17 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:17.653111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.664416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a6c520ac-02ee-4a44-bf4a-63dc03ecf3d6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.164936 Sep 01 05:31:17.664991 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 154/294] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:17 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:17.820246 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:17.820848 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:17.826887 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.827615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.828659 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.829334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:17.829814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:17.830229 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:17.958844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.969609 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.971160 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:17.972242 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a1b6375f-2e80-4e45-a3d3-5e6e39bb34df tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.155896 Sep 01 05:31:17.972796 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 141/295] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:17 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:18.162924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:18.163453 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:18.169242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.169712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.170136 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.170829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.171267 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.171678 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.305927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:18.314127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4c3494c4-e4b3-4b74-8470-614ae9d4b219 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1503 microversion: 2.1 time: 0.155078 Sep 01 05:31:18.326428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 155/296] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:18 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:18.684880 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:18.685484 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:18.692575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.693168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.693624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.694310 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:18.694781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:18.695196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:18.826317 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:18.834204 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9f7bbe80-1438-40d7-ad18-10091326ec55 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.153105 Sep 01 05:31:18.834800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 142/297] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:18 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:18.994755 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:18.995386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:19.001420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.001895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.002319 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.003036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.003483 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.003896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.021636 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:19.129946 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.138015 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.139615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.141246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8bc2c18d-9710-4614-ac14-b902fcfdae1e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.150437 Sep 01 05:31:19.141807 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 156/298] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:18 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:19.336327 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:19.337021 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:19.342854 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.343318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.344350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.345014 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.345449 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.345859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.473207 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:19.481311 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8dc66d10-ff53-4220-9ade-9ea3e121a15f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1503 microversion: 2.1 time: 0.148898 Sep 01 05:31:19.481875 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 143/299] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:19 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:19.854236 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:19.854880 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:19.861209 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.861687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.862115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.865360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:19.865360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:19.865360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:19.993298 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.001881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f3ba9a5d-a824-4932-ab0d-b04703b73198 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.151418 Sep 01 05:31:20.002477 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 157/300] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:19 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:20.164864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:20.165664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:20.172221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.172766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.173238 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.173924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.174435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.174856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.372712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d434ac8-0398-4e29-ac13-8de1d30fc9d8"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:20.375818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:20.383119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.383619 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.384054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.384749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.385492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.385811 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.430423 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.440365 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.442111 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.443491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-76ec978f-88a9-415a-9c5e-c0772491a631 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.282867 Sep 01 05:31:20.444203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 144/301] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:20 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:20.503382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:20.503993 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:20.510339 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.510986 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.511425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.519536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.519536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.519536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:20.712917 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:20.717048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:20.721715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-15566412-cd94-4f24-98fd-e8556bffcdff tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1503 microversion: 2.1 time: 0.223922 Sep 01 05:31:20.722316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 145/302] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:20 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:20.978357 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-30b3a0af-376f-4df0-a055-267b22652843 req-516cc470-a66e-49f1-a8f2-80ed038f77c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a4aa9f-d25b-445f-930d-b79ee132ec6b", "name": "network-vif-deleted", "tag": "dcfb942d-1ba7-452b-a2e8-93d3e7c7cabc"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:20.989322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-30b3a0af-376f-4df0-a055-267b22652843 req-516cc470-a66e-49f1-a8f2-80ed038f77c9 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:20.989786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-30b3a0af-376f-4df0-a055-267b22652843 req-516cc470-a66e-49f1-a8f2-80ed038f77c9 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:20.990202 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-30b3a0af-376f-4df0-a055-267b22652843 req-516cc470-a66e-49f1-a8f2-80ed038f77c9 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.001043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-30b3a0af-376f-4df0-a055-267b22652843 req-516cc470-a66e-49f1-a8f2-80ed038f77c9 service nova] Creating event network-vif-deleted:dcfb942d-1ba7-452b-a2e8-93d3e7c7cabc for instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b on hv-cinder-83602 Sep 01 05:31:21.005908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-30b3a0af-376f-4df0-a055-267b22652843 req-516cc470-a66e-49f1-a8f2-80ed038f77c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031631 Sep 01 05:31:21.006499 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 146/303] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:31:21.022255 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:21.022969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:21.028790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.029255 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.030525 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.031889 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.032352 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.032783 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.177699 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.185939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-417bff38-387f-4389-be96-9f52eddb90c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.167464 Sep 01 05:31:21.186938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 147/304] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:21 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:21.476340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:21.477113 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:21.486067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.486573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.487263 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.488021 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.488404 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.488817 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.678456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.687486 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.688979 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.690140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d46d2d44-74e5-442b-b79d-efba99ac391b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.218703 Sep 01 05:31:21.690741 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 148/305] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:21 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:21.742189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:21.742840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:21.748710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.749184 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.750131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.750834 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:21.751276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:21.751685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:21.834615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:21.842504 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0a32ec41-97d2-488c-8700-10d63b39973b tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1461 microversion: 2.1 time: 0.104121 Sep 01 05:31:21.843075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 149/306] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:21 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1461 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:22.207770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:22.208417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:22.214765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.215238 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.215671 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.216346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.216793 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.217210 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.352587 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.362414 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-98a77b7f-a8ed-431f-9506-9041001fa52c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.158111 Sep 01 05:31:22.363441 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 150/307] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:22 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:22.713485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:22.714428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:22.720232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.720715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.721149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.721829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.722481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.722901 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.856082 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.882563 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.883930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.885083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-974b8f22-d437-4fd1-a300-1b7b82b635dc tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.175516 Sep 01 05:31:22.886068 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 151/308] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:22 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:22.891520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:22.892278 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:22.898747 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.899385 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.899963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.900808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:22.901933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:22.902702 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:22.969844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:22.977590 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6dd23ff2-4638-4475-86aa-d46274062bd4 tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1461 microversion: 2.1 time: 0.091045 Sep 01 05:31:22.978184 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 152/309] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:22 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:23.383913 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:23.384558 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:23.391239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.391653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.392076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.392776 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.393218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.393634 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.523100 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:23.531450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b784c133-7f48-4ff2-a9f2-63047f26b153 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.150898 Sep 01 05:31:23.532026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 153/310] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:23 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:23.913773 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:23.914395 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:23.920391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.921090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.921520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:23.922195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:23.922828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:23.923248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.088185 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.096917 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.098591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.100307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9a49a2ec-612f-4793-85f0-3736b87d1512 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.191567 Sep 01 05:31:24.100864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 154/311] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:23 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:24.123329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:24.124335 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:24.131073 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:24.136782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.136782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.136782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.136782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.137083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.137083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.198235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.206869 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-df63385f-9317-4e36-aa9e-15dd2b045ffa tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1461 microversion: 2.1 time: 0.089741 Sep 01 05:31:24.207424 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 155/312] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:24 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:24.553119 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:24.553801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:24.561007 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.561507 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.562616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.565576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.565576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.565576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.799327 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:24.810555 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cbfb20a8-ac42-4eaa-9d4e-8a7c662d6e00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1501 microversion: 2.1 time: 0.258862 Sep 01 05:31:24.811165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 156/313] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:24 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:24.831115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cca6559-cd18-4b9b-85ca-635be92c6610"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:24.835717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:24.841334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.842019 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.842692 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.844124 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.844728 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.845331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.875309 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] HTTP exception thrown: Cannot 'attach_volume' instance e85c8e8e-97e2-4132-a090-67148112e3e2 while it is in vm_state rescued Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Request method failure captured: Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: POST /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2/os-volume_attachments HTTP/1.1 Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 74 Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM7GY7-05XLd0TeVi-mcVC7JFpzwD-jwqAm6yzcGxeKORICry4_2jTuJQYxckn0sa8vpouuBW1fnYs3rPY-GaQbHyhvEk_-1nIDE-sJJM8vCdO4vhNdmvDpUWoSGqxuHQ21_3-0YRZeb7qQz0vWtun5hHwCroFjtoLhrIJL5KUEFPs Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:31:24.877006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: f4a01fadccd941fc98ecc99dac4e25c4 Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {"volumeAttachment": {"volumeId": "2cca6559-cd18-4b9b-85ca-635be92c6610"}} Sep 01 05:31:24.878490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Cannot 'attach_volume' instance e85c8e8e-97e2-4132-a090-67148112e3e2 while it is in vm_state rescued Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'server_id': 'e85c8e8e-97e2-4132-a090-67148112e3e2', 'body': {'volumeAttachment': {'volumeId': '2cca6559-cd18-4b9b-85ca-635be92c6610'}}} Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e85c8e8e-97e2-4132-a090-67148112e3e2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:31:24.879292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e85c8e8e-97e2-4132-a090-67148112e3e2 while it is in vm_state rescued Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:31:24.880471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:31:24.882360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:31:24.882360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:31:24.882360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e85c8e8e-97e2-4132-a090-67148112e3e2 while it is in vm_state rescued Sep 01 05:31:24.882360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:24.882360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Returning 409 to user: Cannot 'attach_volume' instance e85c8e8e-97e2-4132-a090-67148112e3e2 while it is in vm_state rescued {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:31:24.882360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a9e22871-e16b-4e2b-9d15-8ebacd5b43c0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.051701 Sep 01 05:31:24.882360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 157/314] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:31:24 2022] POST /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2/os-volume_attachments => generated 152 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 05:31:24.887615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:24.888346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:24.894348 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.894881 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.895318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:24.896001 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:24.896450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:24.896865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.077512 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-dd5abace-8717-463e-9503-9a5cdc227148 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.708340 Sep 01 05:31:25.083831 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 158/315] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:31:20 2022] POST /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 194 bytes in 4710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:31:25.133520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:25.134939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:25.144965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.146360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.147035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.147885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.148637 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.149056 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.167666 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8eb72ab9-c95e-450b-8417-630f172be2e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2/action" status: 202 len: 0 microversion: 2.1 time: 0.278868 Sep 01 05:31:25.167666 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 158/316] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:31:24 2022] POST /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:31:25.175854 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:25.176635 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:25.183761 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.184378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.184903 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.185919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.186535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.187049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.310586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.319111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.320592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.321777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ea458093-7c64-4d54-87a2-a7a7e73115b8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.198245 Sep 01 05:31:25.322693 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 159/317] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:25 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:25.328179 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:25.328534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:25.343699 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=67 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:25.347855 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.348418 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.349018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.352312 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.352312 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.352312 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.385231 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:25.385787 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:25.386289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:25.386997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lazy-loading 'fault' on Instance uuid 28a4aa9f-d25b-445f-930d-b79ee132ec6b {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:31:25.434550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '881062ec3efc4445a43e1ff772b09153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1297d0249cf34d7290e867124be62377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.436071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:25.442482 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c3bdc03a-589b-4185-b064-2736bf69bd2d tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 200 len: 1303 microversion: 2.1 time: 0.118628 Sep 01 05:31:25.443053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 160/318] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:25 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 1303 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:25.444059 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8009af2c-1dbd-4f4c-9ee9-e510f98d677c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1509 microversion: 2.1 time: 0.274923 Sep 01 05:31:25.444614 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 159/319] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:25 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:26.346728 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:26.347378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:26.353558 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.354037 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.354480 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.355155 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.355591 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.356001 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.470208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:26.471570 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] [instance: 28a4aa9f-d25b-445f-930d-b79ee132ec6b] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:26.479304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.481269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.481269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.481269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.482138 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.482765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.496097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:26.498194 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] HTTP exception thrown: Instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b could not be found. Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Request method failure captured: Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b HTTP/1.1 Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEENqzBF6OaVIPtibPmb8UcCoHaTT4l0__q4Rr02RfZOR4YFHYfBnyLbMP4SNvrK29SqKmXixKHnSBEfZKp_iAYofXA9j17onsr7pBw-lhnWBZo0jrB_BW1M4u9Lk5esOB8hmnhRzctN3J-fqVADnpqfS70ytPbk9pMNj09icFY-5adI Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1297d0249cf34d7290e867124be62377 Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesActionsTest-170987217 Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:31:26.500239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1297d0249cf34d7290e867124be62377"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1297d0249cf34d7290e867124be62377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1297d0249cf34d7290e867124be62377"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1297d0249cf34d7290e867124be62377"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesActionsTest-170987217 Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1297d0249cf34d7290e867124be62377 Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesActionsTest-170987217 Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesActionsTest-170987217-project Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 881062ec3efc4445a43e1ff772b09153 Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesActionsTest-170987217-project Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b could not be found. Sep 01 05:31:26.501491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '28a4aa9f-d25b-445f-930d-b79ee132ec6b'} Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b could not be found. Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:31:26.502200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b could not be found. Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b could not be found. Sep 01 05:31:26.503412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:31:26.505098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:26.505949 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] Returning 404 to user: Instance 28a4aa9f-d25b-445f-930d-b79ee132ec6b could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:31:26.506622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:26.507040 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-82c53871-350e-4acd-8702-93180214214f tempest-VolumesActionsTest-170987217 tempest-VolumesActionsTest-170987217-project] 10.222.0.16 "GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b" status: 404 len: 111 microversion: 2.1 time: 0.041435 Sep 01 05:31:26.508071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 160/320] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:26 2022] GET /compute/v2.1/servers/28a4aa9f-d25b-445f-930d-b79ee132ec6b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:31:26.508446 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7a9b44d7-68a7-4174-9467-cb0d98a7ff75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.166852 Sep 01 05:31:26.509435 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 161/321] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:26 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:26.521890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:26.522602 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:26.532981 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.538235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.538235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.538235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:26.538235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:26.538962 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:26.670934 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:26.678744 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dbbfe992-1163-422f-9be2-d1d87987fcf9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1509 microversion: 2.1 time: 0.169306 Sep 01 05:31:26.679294 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 161/322] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:26 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:27.543685 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:27.544280 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:27.551518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.552000 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.554388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.554388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.554388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.554388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.699573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:27.700162 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:27.704577 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.707281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.707758 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.708195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.708882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:27.709349 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:27.709815 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:27.713208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.714720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.716013 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a2b13304-c5fc-4f08-a840-d28f3446faf5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.176197 Sep 01 05:31:27.716695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 162/323] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:27 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:27.849298 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:27.858157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-64560434-4cf9-4f39-9a3a-705185c91a0e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1509 microversion: 2.1 time: 0.162496 Sep 01 05:31:27.859385 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 162/324] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:27 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:28.740426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:28.740950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:28.747315 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.747782 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.748201 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.748869 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.749874 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.750326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.884827 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:28.886147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:28.896550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.903484 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.903484 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.903484 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:28.903484 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:28.904079 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:28.909876 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:29.023594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.031859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.033291 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.034447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7375948f-692c-4f65-b0a5-3af902971a2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.298095 Sep 01 05:31:29.035119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 163/325] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:28 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:29.043000 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:29.052054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c799081f-4e39-48af-9d18-50baa607f238 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1509 microversion: 2.1 time: 0.174567 Sep 01 05:31:29.055161 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 163/326] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:28 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:30.056886 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:30.057476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:30.064257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.064727 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.065149 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.065819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.066257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.066692 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.074316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:30.074975 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:30.082953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.083423 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.083849 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.084520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:30.084964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:30.085376 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:30.201708 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.210587 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.212356 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.213496 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ee7df8a0-92a7-45d5-91a0-523817bb814b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.160432 Sep 01 05:31:30.214042 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 164/327] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:30 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:30.233003 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:30.241031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e2a5ea8b-a007-41b1-a33a-8f242120bcf0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1509 microversion: 2.1 time: 0.170604 Sep 01 05:31:30.241799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 164/328] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:30 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:31.238240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:31.238796 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:31.245250 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.245715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.246142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.246848 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.247296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.247715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.262287 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:31.262918 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:31.269215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.269688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.270116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.270842 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:31.271292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:31.271707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:31.395734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.403700 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.405177 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.406323 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e5c9b64a-42ee-4957-b39a-41e709cf354a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.172108 Sep 01 05:31:31.406895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 165/329] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:31 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:31.413351 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:31.421542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a23c2332-653e-4b6d-8eae-8d5e006c12ed tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1509 microversion: 2.1 time: 0.162524 Sep 01 05:31:31.422092 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 165/330] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:31 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:32.429613 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:32.430301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:32.437197 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.437761 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.438263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.439034 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.439484 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.439897 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.443805 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:32.446353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:32.450864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.451608 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.452629 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.453323 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:32.453745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:32.454228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:32.572915 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.582089 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.583557 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.584696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-92ed2066-c2ab-43c9-a880-3a18d70fc066 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.159176 Sep 01 05:31:32.585298 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 166/331] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:32 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:32.588568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:32.596365 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-62bd3193-9fc5-485c-8f53-ef21e1cdfa88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1509 microversion: 2.1 time: 0.156643 Sep 01 05:31:32.596872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 166/332] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:32 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:33.608341 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:33.609038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:33.620944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.621445 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.621879 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.622488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:33.622939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.623211 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.623574 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.623954 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:33.641200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.643715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.644180 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.644919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:33.645439 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:33.645861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:33.822558 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.837662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-08c9ed01-49dd-47a3-9ff2-57961127c4cc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1509 microversion: 2.1 time: 0.219145 Sep 01 05:31:33.838227 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 167/333] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:33 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:33.852139 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.860539 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.861992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:33.863264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1d3b19f7-51d9-4cd6-b7fd-4a96fa25bd2a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.258853 Sep 01 05:31:33.863705 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 167/334] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:33 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:34.858718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:34.859304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:34.865904 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.866377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.866855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.867527 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.868007 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.868421 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.889107 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:34.889723 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:34.921493 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.922074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.922387 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:34.923097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:34.923673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:34.923952 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:35.086780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.094545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4764bb71-0faf-4b60-9674-c65eedb7f7b5 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1515 microversion: 2.1 time: 0.240226 Sep 01 05:31:35.095107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 168/335] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:34 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:35.140039 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.143883 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.145334 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:35.146621 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5dffcc38-80cc-43be-ba9a-63d890e169ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1744 microversion: 2.20 time: 0.261249 Sep 01 05:31:35.147068 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 168/336] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:34 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1744 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:36.170742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:36.171244 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:36.182181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:36.182687 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:36.183257 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:36.183987 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:36.184458 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:36.184869 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:36.332146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:36.340104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:36.341554 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:36.342717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ed355719-6597-4091-9620-ac69edf6f3f9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1744 microversion: 2.20 time: 0.176021 Sep 01 05:31:36.343269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 169/337] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:36 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:37.365247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:37.365848 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:37.372319 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:37.372794 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:37.373397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:37.374084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:37.374564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:37.374985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:37.508252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.516918 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.518357 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:37.519529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fabb8ca3-55e1-4380-b30c-2ef5e831641d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1744 microversion: 2.20 time: 0.158293 Sep 01 05:31:37.520077 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 169/338] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:37 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:38.542685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:38.543286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:38.549781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.550252 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.550709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.551390 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:38.551837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:38.552254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:38.692850 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.703435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.704997 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:38.706431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f9f6039a-ed8b-42b9-b55f-ee16c6635132 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.167913 Sep 01 05:31:38.707025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 170/339] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:38 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:39.091701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c3c256f3-c0e0-40c6-950c-acbb951f9428 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'create', calling method: .version_select at 0x7f953b0ee4c0>, body: {"keypair": {"name": "tempest-keypair-1888678335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEu7d65qWcjBdFyrjkJLWQ+OsSvp1Ns/3gwPkmaFsEnLPBuQiYGMTzDRaiV8xoGVN4kBzSyXQyaKTGGLLddf2UMo16O3g3OjHFddIJETxHtEg14s/o/tWVPTf04F6qIWjQ=="}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:39.125214 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-c3c256f3-c0e0-40c6-950c-acbb951f9428 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Getting quotas for project b34f5b5ce7c44930b3c85701d9ceb384. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:39.131802 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-c3c256f3-c0e0-40c6-950c-acbb951f9428 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Getting quotas for user f4a01fadccd941fc98ecc99dac4e25c4 and project b34f5b5ce7c44930b3c85701d9ceb384. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:39.468119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c3c256f3-c0e0-40c6-950c-acbb951f9428 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.381678 Sep 01 05:31:39.468985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 170/340] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:31:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:39.741582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:39.742364 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:39.750478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.751459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.751893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.752762 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:39.753381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:39.753972 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:39.947282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.957248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.958940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:39.960269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-187ee3b0-66a7-492c-9f57-6fc880cf3afe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.223193 Sep 01 05:31:39.960825 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 171/341] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:39 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:40.253165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-522c6143-86dd-4747-8f2c-de2303aa700c req-846fb1c1-f2b8-405b-a520-69bd3a8eef06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4659e047-b384-4220-b0d3-26e9f67354c5", "name": "network-vif-plugged", "status": "completed", "tag": "7cbd2023-a83e-445a-b3a8-6aadb6c3c59c"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:40.272933 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-522c6143-86dd-4747-8f2c-de2303aa700c req-846fb1c1-f2b8-405b-a520-69bd3a8eef06 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:40.273635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-522c6143-86dd-4747-8f2c-de2303aa700c req-846fb1c1-f2b8-405b-a520-69bd3a8eef06 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:40.274649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-522c6143-86dd-4747-8f2c-de2303aa700c req-846fb1c1-f2b8-405b-a520-69bd3a8eef06 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:40.301756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-522c6143-86dd-4747-8f2c-de2303aa700c req-846fb1c1-f2b8-405b-a520-69bd3a8eef06 service nova] Creating event network-vif-plugged:7cbd2023-a83e-445a-b3a8-6aadb6c3c59c for instance 4659e047-b384-4220-b0d3-26e9f67354c5 on hv-cinder-83602 Sep 01 05:31:40.309376 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-522c6143-86dd-4747-8f2c-de2303aa700c req-846fb1c1-f2b8-405b-a520-69bd3a8eef06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059976 Sep 01 05:31:40.310507 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 171/342] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:40.990083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:40.991159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:41.005147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:41.005718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:41.006245 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:41.007148 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:41.008275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:41.014890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:41.543966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5f6ab320-1069-4039-9ef5-08db4da97756 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: .version_select at 0x7f953b189790>, body: {"keypair": {"name": "tempest-keypair-883759414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVXzIe4fTDvkfd7fDRgIJ/sRwlZFuHSIeBz/+66jylvhBADxGCECp0vie+pa0X+NIMVHilu7q+X1MlgbtlzjyLq/c73hl5O+srIMvhJ0X4KNSSSE6aMNsAyzmFcECSwfw=="}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:41.596528 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-5f6ab320-1069-4039-9ef5-08db4da97756 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for project 1a200065c13e42babe6353689aabd896. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:41.606269 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-5f6ab320-1069-4039-9ef5-08db4da97756 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for user 11770fbaeacd4fc7bc4052e83630dbb3 and project 1a200065c13e42babe6353689aabd896. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:41.706658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:41.717561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:41.720851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:41.723254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c6d538d3-f2e1-4674-8b0d-c25f3a75b477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.743132 Sep 01 05:31:41.730633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 172/343] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:40 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:41.804346 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5f6ab320-1069-4039-9ef5-08db4da97756 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256585 Sep 01 05:31:41.804346 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 172/344] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:31:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:31:42.766064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:42.771479 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:42.780983 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:42.781471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:42.781894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:42.785283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:42.785748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:42.786173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:43.005668 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.038986 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.048187 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:43.059562 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-680a6dcf-7bab-4a19-91c4-478a0b501af0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.306630 Sep 01 05:31:43.060938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 173/345] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:42 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:43.228070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2000441444", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d22d36b6-30d8-42bc-8d1d-e8136d4e46da"}], "security_groups": [{"name": "tempest-securitygroup--848095888"}], "key_name": "tempest-keypair-1888678335", "user_data": "}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:44.093302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:44.095320 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:44.109053 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.111393 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.113761 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.116747 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:44.117837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:44.120151 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:44.341314 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.355920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.357372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:44.358598 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-eca0f8d0-3678-45c9-a0a3-21b1b377d80e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.273108 Sep 01 05:31:44.373283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 174/346] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:44 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:44.961207 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-497949818", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00c5deda-d635-4d45-9035-2f4ba75e32f9"}], "security_groups": [{"name": "tempest-securitygroup--1861150166"}], "key_name": "tempest-keypair-883759414", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:31:50.294582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:51.621202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=8 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:53.243445 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:53.484454 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] validate_networks() for [('00c5deda-d635-4d45-9035-2f4ba75e32f9', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:31:53.499524 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] validate_networks() for [('d22d36b6-30d8-42bc-8d1d-e8136d4e46da', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:31:54.154623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:31:54.155443 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:31:54.155978 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:31:54.156387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:31:54.156794 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:31:54.166718 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:31:54.167349 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:31:54.167979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:31:54.168548 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:31:54.169113 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:31:54.180382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.182380 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.184172 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.185183 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.186975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.187449 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.188116 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.188752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.190215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.191959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.192621 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.193046 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.236095 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for project 1a200065c13e42babe6353689aabd896. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:54.240034 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Getting quotas for project b34f5b5ce7c44930b3c85701d9ceb384. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:31:54.245753 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for user 11770fbaeacd4fc7bc4052e83630dbb3 and project 1a200065c13e42babe6353689aabd896. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:54.247983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Getting quotas for user f4a01fadccd941fc98ecc99dac4e25c4 and project b34f5b5ce7c44930b3c85701d9ceb384. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:31:54.261364 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:31:54.262129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:31:54.264600 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:31:54.267699 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:31:54.416232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f89eabae-dcc4-47eb-bfd1-b091922788d0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 9.459567 Sep 01 05:31:54.420497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 175/347] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:31:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 9464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:31:54.430938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:54.431554 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:54.449710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.451991 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.454601 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.455522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:54.455984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:54.456408 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:54.473535 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-705151f8-a553-4bd1-91a6-0f696bc7309e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 11.252322 Sep 01 05:31:54.479773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 173/348] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:31:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 11258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:31:54.500992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b8993de4-0448-4214-ab5f-f733dc3c8a8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:54.503584 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b8993de4-0448-4214-ab5f-f733dc3c8a8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:54.606875 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b8993de4-0448-4214-ab5f-f733dc3c8a8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.618993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b8993de4-0448-4214-ab5f-f733dc3c8a8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1240 microversion: 2.1 time: 0.134984 Sep 01 05:31:54.620164 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 174/349] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:54 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1240 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:54.638041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-28a7b709-ded5-4d9e-b969-8058621e207f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:54.638333 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-28a7b709-ded5-4d9e-b969-8058621e207f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:54.690591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.711764 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.727435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.732120 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3a805cf9-293e-4dfe-967a-34cf95544d9b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.308470 Sep 01 05:31:54.738196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 176/350] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:54 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:54.760252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-28a7b709-ded5-4d9e-b969-8058621e207f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:54.768348 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-28a7b709-ded5-4d9e-b969-8058621e207f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1246 microversion: 2.1 time: 0.146915 Sep 01 05:31:54.769258 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 175/351] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:54 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1246 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:55.649494 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a502fe5c-8606-4b67-909c-0e9e27b30b56 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:55.650834 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a502fe5c-8606-4b67-909c-0e9e27b30b56 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:55.663870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:55.767816 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:55.769085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:55.785977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.790764 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a502fe5c-8606-4b67-909c-0e9e27b30b56 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.816760 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a502fe5c-8606-4b67-909c-0e9e27b30b56 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1240 microversion: 2.1 time: 0.157944 Sep 01 05:31:55.823820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.823820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.823820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:55.823820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:55.824296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:55.824397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 177/352] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1240 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:55.824397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b42b40ba-af68-4b0b-959a-3e53214770c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:55.824397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b42b40ba-af68-4b0b-959a-3e53214770c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:55.908977 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b42b40ba-af68-4b0b-959a-3e53214770c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:55.921341 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b42b40ba-af68-4b0b-959a-3e53214770c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1246 microversion: 2.1 time: 0.109020 Sep 01 05:31:55.937088 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 178/353] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:56.052089 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.063763 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.065639 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:56.067078 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-19f9e370-0a95-45a2-bbc1-bad37d8de031 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.305142 Sep 01 05:31:56.082495 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 176/354] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:55 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:56.833556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:56.835939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:56.862005 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.866394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.869428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.870395 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.871371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.873557 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.943726 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:56.945081 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:56.955527 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.958485 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.959282 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:56.960824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:56.964332 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:56.965029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.041623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:57.056072 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-acfd653d-d556-47d5-bdef-af9af6bcf7f3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1236 microversion: 2.1 time: 0.222779 Sep 01 05:31:57.057266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 179/355] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:56 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1236 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:57.095488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:57.096534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:57.108545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.109326 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.109923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.117897 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:57.117897 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:57.117897 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:57.121538 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:57.141136 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f840a65c-7d52-4ddf-a190-ba20226711c9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1298 microversion: 2.1 time: 0.201308 Sep 01 05:31:57.147122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 177/356] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:56 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:57.459266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:57.470185 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:57.471665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:57.475103 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9766c2b1-d65d-4601-bf97-37b1a7316ff1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.383963 Sep 01 05:31:57.491804 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 180/357] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:57 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:31:58.085644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:58.088035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:58.099479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.100677 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.101325 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.102317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.103022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.103669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.173440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:58.174099 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:58.211682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.218177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.218765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.219595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.222262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.223199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.286722 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.303041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-91a86b12-bfd9-431c-aed3-eee492e44464 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1292 microversion: 2.1 time: 0.222308 Sep 01 05:31:58.304405 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 178/358] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:58 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1292 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:58.455428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.470163 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2b7c7004-162c-4e1f-baed-b98414ff7139 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1306 microversion: 2.1 time: 0.300478 Sep 01 05:31:58.471246 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 181/359] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:58 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1306 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:31:58.501010 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:58.502027 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:58.520291 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.527884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.528494 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.531508 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:58.533693 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:58.535738 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:58.968205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.974117 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.975986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:58.977382 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-edf92175-5728-4eba-95c1-8b6cec2eb930 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.480601 Sep 01 05:31:58.978960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 179/360] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:31:58 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:31:59.329160 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.329830 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.337870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.338469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.339492 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.340425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.340943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.341679 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.365233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:31:59.448778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.460520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-575cafc3-356f-47b5-be73-59d165985f1e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1310 microversion: 2.1 time: 0.136918 Sep 01 05:31:59.472074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 182/361] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1310 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:31:59.493717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:31:59.495016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:31:59.513460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.513460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.516426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.528443 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:31:59.531224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:31:59.531679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:31:59.926303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:31:59.933908 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1186a6e7-9e4c-47fc-a19a-9f862b5b7069 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1304 microversion: 2.1 time: 0.444072 Sep 01 05:31:59.934500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 180/362] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:31:59 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1304 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:00.005588 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:00.006705 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:00.015143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.019290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.020036 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.020976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.021648 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.022223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.484392 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:00.485212 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:00.506450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.507868 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.522513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.523826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.524314 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.528394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.542256 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.576588 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.582546 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.586349 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0de86566-6b06-4c7c-bf59-caccaee017d0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.585074 Sep 01 05:32:00.591302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 183/363] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:00 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:00.966146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:00.967328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:00.981247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.983710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.984244 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:00.986094 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:00.986942 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:00.994809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:00.996809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.001853 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f1cb4e79-ee71-46d6-b567-fa26ea546757 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.518632 Sep 01 05:32:01.004950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 181/364] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:00 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:01.476558 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.489465 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b3fb4474-88ce-4a5f-b781-ddeb21cd5f57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.536281 Sep 01 05:32:01.492170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 184/365] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:00 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:01.614755 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:01.615729 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:01.626724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.633055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.633055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.633055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.633055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.633539 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.798193 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.809378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.812484 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:01.815845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-07398163-54bf-4de9-8579-5991da9c4477 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.205361 Sep 01 05:32:01.819405 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 182/366] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:01 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:01.857188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-856e5a32-89af-4fdc-9753-d7ca02e814ab req-577bf53d-705e-4aff-ba5e-ad79f2241f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5080257c-de42-42cc-8244-50ab47c0e94e", "tag": "949d3bbf-73a4-48d0-bf61-aae262058036"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:01.876338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-856e5a32-89af-4fdc-9753-d7ca02e814ab req-577bf53d-705e-4aff-ba5e-ad79f2241f46 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:01.876853 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-856e5a32-89af-4fdc-9753-d7ca02e814ab req-577bf53d-705e-4aff-ba5e-ad79f2241f46 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:01.877240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-856e5a32-89af-4fdc-9753-d7ca02e814ab req-577bf53d-705e-4aff-ba5e-ad79f2241f46 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:01.895428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-856e5a32-89af-4fdc-9753-d7ca02e814ab req-577bf53d-705e-4aff-ba5e-ad79f2241f46 service nova] Creating event network-changed:949d3bbf-73a4-48d0-bf61-aae262058036 for instance 5080257c-de42-42cc-8244-50ab47c0e94e on hv-cinder-83602 Sep 01 05:32:01.900426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-856e5a32-89af-4fdc-9753-d7ca02e814ab req-577bf53d-705e-4aff-ba5e-ad79f2241f46 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047354 Sep 01 05:32:01.901209 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 185/367] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:01.990995 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-949f2020-33c5-4dc0-ae73-b042aeaa9d9a req-f151d7ec-ed29-4798-81ee-015a525603cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8", "tag": "2d4a1424-e280-43c5-9a9b-43fb5a110f2c"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:02.008000 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-949f2020-33c5-4dc0-ae73-b042aeaa9d9a req-f151d7ec-ed29-4798-81ee-015a525603cc service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.009588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-949f2020-33c5-4dc0-ae73-b042aeaa9d9a req-f151d7ec-ed29-4798-81ee-015a525603cc service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.009588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-949f2020-33c5-4dc0-ae73-b042aeaa9d9a req-f151d7ec-ed29-4798-81ee-015a525603cc service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.032824 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.033465 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.052509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-949f2020-33c5-4dc0-ae73-b042aeaa9d9a req-f151d7ec-ed29-4798-81ee-015a525603cc service nova] Creating event network-changed:2d4a1424-e280-43c5-9a9b-43fb5a110f2c for instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 on hv-cinder-83602 Sep 01 05:32:02.054936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.056141 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.060834 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.062583 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.063231 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.063817 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.072590 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-949f2020-33c5-4dc0-ae73-b042aeaa9d9a req-f151d7ec-ed29-4798-81ee-015a525603cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085443 Sep 01 05:32:02.074227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 183/368] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:32:02.457396 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.465686 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7255509d-67f7-4d0c-b2dc-b4d2e8e06abf tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.438428 Sep 01 05:32:02.466491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 186/369] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:02.520069 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.521010 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.529038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.537656 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.540446 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.541420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.542276 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.542891 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.782779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:02.792897 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3a4750a4-ddc0-4dc6-81cb-1b86e830e3a7 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.280817 Sep 01 05:32:02.803494 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 184/370] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:02.851209 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:02.852372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:02.862262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.863031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.865739 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:02.869032 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:02.869605 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:02.870094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.132048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.142953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.145010 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.146711 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-45640b77-2168-48f1-97b9-8bfa8cf08419 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.301059 Sep 01 05:32:03.147967 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 187/371] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:02 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:03.490441 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:03.491294 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:03.503188 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.506756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.507214 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.507931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.508398 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.511635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.821458 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:03.821878 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:03.829022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.829732 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.830325 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.833389 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:03.834017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:03.834648 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:03.858735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.868899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-95db5abb-4ddb-4fab-92f5-614f4a605632 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.382303 Sep 01 05:32:03.870532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 185/372] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:03.980356 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:03.987920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0c57ee91-72e3-4c02-b06f-ef9f48bed555 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.176033 Sep 01 05:32:03.988481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 188/373] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:03 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:04.180100 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:04.180654 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:04.187240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.187712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.188145 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.188818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.189264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.189680 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.221591 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:04.331246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.339754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.341226 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:04.342381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6ea73085-6f10-4f3d-8e86-4474fc7c11c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.166372 Sep 01 05:32:04.343178 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 186/374] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:04 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:04.891533 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:04.892143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:04.894126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:04.900013 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.900490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.901118 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:04.901969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:04.902694 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:04.903281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.009991 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.011344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.020008 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=10 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:05.022958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.023722 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.024993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.025858 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.026434 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.027578 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.054731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.070918 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7276acd3-8692-4bb0-a389-6b35d6bcb557 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.183762 Sep 01 05:32:05.072068 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 189/375] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:04 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:05.194304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.207837 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-53782bc9-5683-4109-9fdb-d6f3147f0bfc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.202707 Sep 01 05:32:05.210079 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 187/376] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:05.365454 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:05.366438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:05.374953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.375551 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.376216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.377189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:05.377876 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:05.378499 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:05.548939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.558582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.560606 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:05.561747 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f619656e-9085-4870-99ed-71ebfa373435 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.200535 Sep 01 05:32:05.562633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 190/377] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:05 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:06.093532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.094132 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.100864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.101542 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.102122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.103084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.103540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.104071 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.229026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.233560 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=10 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:06.238678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.239461 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.240140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.241043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.241692 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.242315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.256723 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.264645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a05be8f1-94ac-4d47-9832-189dd9c1c2f7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.175386 Sep 01 05:32:06.265422 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 188/378] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:06.401591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.425136 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-128a4b58-2cfa-482f-829d-ef25a4ce49c1 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.198768 Sep 01 05:32:06.425723 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 191/379] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:06.585896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:06.586667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:06.594364 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.595147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.595846 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.596943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:06.597684 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:06.598295 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:06.799976 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.808925 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.811022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:06.812207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7fbbd86b-36a3-47b8-bb2a-d60f0e23998b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.230401 Sep 01 05:32:06.827562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 189/380] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:06 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:07.287149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:07.287976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:07.298608 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.299676 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.300360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.302079 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.303502 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.304872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.446681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:07.448353 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:07.455778 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.456342 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.457731 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.458694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.459820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.460869 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.638242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:07.648115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c516e8cd-df45-456c-a68c-773f0e667553 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.205493 Sep 01 05:32:07.649016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 190/381] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:07 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:07.845098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:07.845098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:07.846250 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.846778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:07.846920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.847672 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.847962 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:07.848419 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:07.848840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:07.854805 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-116dcc58-bf71-4a00-b073-b5a7e4aa9e17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.571929 Sep 01 05:32:07.855368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 192/382] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:07 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:08.016035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.024916 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.026450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.027588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-741b867a-2a69-4f6e-88b9-98f8f58f9339 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.192740 Sep 01 05:32:08.030790 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 191/383] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:07 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:08.671870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:08.671870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.681402 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.681991 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.682658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.683673 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.684324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.685512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.883215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:08.883965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:08.895471 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.896236 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.896823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.897679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:08.898281 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:08.898868 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:08.912813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:08.920990 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e69cb1e8-e9bf-450f-9d1c-0569f7e9bd50 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.255562 Sep 01 05:32:08.922049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 193/384] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:08 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:09.054478 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.055436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:09.056058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:09.057844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:09.062415 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.062898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.063322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.063435 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-89392b3e-dc06-4b73-b202-3631ffdc7626 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.183698 Sep 01 05:32:09.063980 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 192/385] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:08 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:09.064121 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.064425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.064837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.204215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.218396 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.219924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:09.221990 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9878187c-3dc9-4711-8ede-6433c5cd93f1 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1739 microversion: 2.20 time: 0.170385 Sep 01 05:32:09.222670 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 194/386] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:09 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:09.313153 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-03fabe23-414a-40d8-a0c4-fec4d26f5166 req-5358e488-c617-48bc-b3db-02aa7f848d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8", "name": "network-vif-plugged", "status": "completed", "tag": "2d4a1424-e280-43c5-9a9b-43fb5a110f2c"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:09.323836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-03fabe23-414a-40d8-a0c4-fec4d26f5166 req-5358e488-c617-48bc-b3db-02aa7f848d25 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.324022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-03fabe23-414a-40d8-a0c4-fec4d26f5166 req-5358e488-c617-48bc-b3db-02aa7f848d25 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.324707 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-03fabe23-414a-40d8-a0c4-fec4d26f5166 req-5358e488-c617-48bc-b3db-02aa7f848d25 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.339394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-03fabe23-414a-40d8-a0c4-fec4d26f5166 req-5358e488-c617-48bc-b3db-02aa7f848d25 service nova] Creating event network-vif-plugged:2d4a1424-e280-43c5-9a9b-43fb5a110f2c for instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 on hv-cinder-83602 Sep 01 05:32:09.344765 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-03fabe23-414a-40d8-a0c4-fec4d26f5166 req-5358e488-c617-48bc-b3db-02aa7f848d25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035987 Sep 01 05:32:09.346097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 193/387] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:09.941840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:09.942466 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:09.950846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.951335 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.951769 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:09.952488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:09.953247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:09.954014 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.088623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.093350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.100944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.101438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.101873 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.102607 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.103064 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.103486 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.129193 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.141166 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f90cff6c-ee04-4ded-88c2-6004f329a793 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.203023 Sep 01 05:32:10.156658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 195/388] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:09 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:10.245251 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:10.245964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:10.251812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.252283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.252708 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.253378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:10.253813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:10.254246 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:10.311979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.321534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-13f82dd5-b894-41d1-a330-af8a021bdd6f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.239495 Sep 01 05:32:10.322951 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 194/389] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:10 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:10.393147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.405460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.405460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:10.405460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-da3baeed-fbe6-47f6-900d-71ccf14cbd7e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1721 microversion: 2.20 time: 0.163774 Sep 01 05:32:10.406214 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 196/390] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:10 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:11.162867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.163404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.169979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.170499 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.170969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.171679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.172124 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.172544 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.325836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.334125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-915f43d4-11e2-45c8-88a5-bee8e5d84637 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.175250 Sep 01 05:32:11.334734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 195/391] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:11.343364 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.343958 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.351709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.352693 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.353588 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.354485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.355012 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.355509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.361407 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-72a63d00-c7c8-465d-8ee3-f308e9aa9d18 req-c06dfc75-364a-4df3-b33a-a3101d3f71f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5080257c-de42-42cc-8244-50ab47c0e94e", "name": "network-vif-plugged", "status": "completed", "tag": "949d3bbf-73a4-48d0-bf61-aae262058036"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:11.371272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-72a63d00-c7c8-465d-8ee3-f308e9aa9d18 req-c06dfc75-364a-4df3-b33a-a3101d3f71f9 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.371840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-72a63d00-c7c8-465d-8ee3-f308e9aa9d18 req-c06dfc75-364a-4df3-b33a-a3101d3f71f9 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.372781 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-72a63d00-c7c8-465d-8ee3-f308e9aa9d18 req-c06dfc75-364a-4df3-b33a-a3101d3f71f9 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.383659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-72a63d00-c7c8-465d-8ee3-f308e9aa9d18 req-c06dfc75-364a-4df3-b33a-a3101d3f71f9 service nova] Creating event network-vif-plugged:949d3bbf-73a4-48d0-bf61-aae262058036 for instance 5080257c-de42-42cc-8244-50ab47c0e94e on hv-cinder-83602 Sep 01 05:32:11.388977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-72a63d00-c7c8-465d-8ee3-f308e9aa9d18 req-c06dfc75-364a-4df3-b33a-a3101d3f71f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031194 Sep 01 05:32:11.389874 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 196/392] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:32:11.429882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:11.430889 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:11.438031 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.438830 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.439476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.440463 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:11.441091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:11.441691 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:11.518627 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.527991 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d1992827-eb54-481f-83b6-518b5d7665db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.188386 Sep 01 05:32:11.542060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 197/393] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:11.819408 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.827678 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.829125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:11.830265 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-679e1e6e-f220-41ba-8c7e-488d08a8a0dd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1721 microversion: 2.20 time: 0.404703 Sep 01 05:32:11.830848 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 197/394] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:11 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1721 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:12.354505 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.358997 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.361651 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.362120 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.362581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.363417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.363876 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.364394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.496436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.504072 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5422a22f-eea4-4312-aba8-b0ba13a3905b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.153550 Sep 01 05:32:12.504633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 198/395] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:12.550303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.550888 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.557211 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.557683 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.558107 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.558803 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.559244 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.559680 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.694470 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:12.706068 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-69fc663e-eba5-4ee9-acd1-a2cdb01217e7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.159585 Sep 01 05:32:12.718429 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 198/396] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:12.852457 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:12.853049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:12.859913 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.860389 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.860823 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:12.861581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:12.861963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:12.863067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.091354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.094894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:13.100155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.101792 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.103063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-524e4476-847e-4118-ad67-37f53e0df54d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1721 microversion: 2.20 time: 0.254462 Sep 01 05:32:13.103626 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 199/397] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:12 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:13.525894 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:13.527125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:13.533744 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.534701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.535627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.536632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.537286 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.537960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.678613 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.686238 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-10eb5ce4-8324-4e35-84aa-42b1cdbdcd93 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1371 microversion: 2.1 time: 0.164833 Sep 01 05:32:13.686919 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 199/398] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:13 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:13.727513 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:13.728221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:13.735637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.736186 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.736622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.737297 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:13.737753 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:13.738168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:13.866801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:13.874418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c098a06c-58e9-407f-adb4-5e7aa5a28f78 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.150893 Sep 01 05:32:13.874991 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 200/399] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:13 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:14.126136 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:14.127351 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:14.133578 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.134084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.134546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.138363 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.138363 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.138363 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.267441 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.275436 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.276862 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.278163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1594762a-884f-4c9f-8157-0ff25f6d60a5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1721 microversion: 2.20 time: 0.156214 Sep 01 05:32:14.278768 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 200/400] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:14 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:14.717135 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:14.717135 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:14.721346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.721885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.722603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.723349 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.724549 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.724929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.855740 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:14.863480 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-088ed150-c583-44d0-87e8-b7b6e2e2829d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1566 microversion: 2.1 time: 0.160098 Sep 01 05:32:14.864048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 201/401] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:14 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:14.887862 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:14.888402 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:14.895091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:14.895699 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:14.896050 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.896659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.897156 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.898015 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.898683 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.899253 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.901712 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.902199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.902660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.903977 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:14.904431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:14.904885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:14.992409 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-77998452-13bd-44a7-bdb1-925330fdc20c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112217 Sep 01 05:32:14.999092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 201/402] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 05:32:14 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:15.052243 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.063249 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0832e8ab-8625-47ea-8831-7dc12fa25251 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.171784 Sep 01 05:32:15.064148 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 202/403] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:14 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:15.301553 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:15.302154 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:15.308515 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.308986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.309984 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.310686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:15.311261 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:15.311728 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:15.556989 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.567293 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.569148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:15.570538 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e646bda9-bc6e-45eb-981d-82b08826f804 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1721 microversion: 2.20 time: 0.273351 Sep 01 05:32:15.585633 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 202/404] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:15 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1721 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:16.085289 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:16.087829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:16.093054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.093532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.093963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.094751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.095205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.095623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.191717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-8b5b5b91-ffc2-4d75-a413-fdf937033760 req-26bd3af9-a26c-4620-8e7d-978b76c26fcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8", "tag": "2d4a1424-e280-43c5-9a9b-43fb5a110f2c"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:16.206581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8b5b5b91-ffc2-4d75-a413-fdf937033760 req-26bd3af9-a26c-4620-8e7d-978b76c26fcd service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.207278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8b5b5b91-ffc2-4d75-a413-fdf937033760 req-26bd3af9-a26c-4620-8e7d-978b76c26fcd service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.207956 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8b5b5b91-ffc2-4d75-a413-fdf937033760 req-26bd3af9-a26c-4620-8e7d-978b76c26fcd service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.222176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-8b5b5b91-ffc2-4d75-a413-fdf937033760 req-26bd3af9-a26c-4620-8e7d-978b76c26fcd service nova] Creating event network-changed:2d4a1424-e280-43c5-9a9b-43fb5a110f2c for instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 on hv-cinder-83602 Sep 01 05:32:16.229278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-8b5b5b91-ffc2-4d75-a413-fdf937033760 req-26bd3af9-a26c-4620-8e7d-978b76c26fcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044361 Sep 01 05:32:16.230222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 203/405] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:32:16.245659 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.247539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e2a76aa3-f53d-43dc-99c0-7809cccc44af tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1366 microversion: 2.1 time: 0.166275 Sep 01 05:32:16.248325 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 203/406] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:16 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:16.594853 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:16.595541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:16.607240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.607240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.607240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.607240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.607604 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.607604 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.693251 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-b0507835-5bc0-4a27-a24d-c31c4caf1ecf req-74ad6f10-6488-4ae8-a47e-005d8b616111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4659e047-b384-4220-b0d3-26e9f67354c5", "name": "network-vif-unplugged", "status": "completed", "tag": "7cbd2023-a83e-445a-b3a8-6aadb6c3c59c"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:16.718564 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b0507835-5bc0-4a27-a24d-c31c4caf1ecf req-74ad6f10-6488-4ae8-a47e-005d8b616111 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:16.720236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b0507835-5bc0-4a27-a24d-c31c4caf1ecf req-74ad6f10-6488-4ae8-a47e-005d8b616111 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:16.722317 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-b0507835-5bc0-4a27-a24d-c31c4caf1ecf req-74ad6f10-6488-4ae8-a47e-005d8b616111 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:16.754115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-b0507835-5bc0-4a27-a24d-c31c4caf1ecf req-74ad6f10-6488-4ae8-a47e-005d8b616111 service nova] Creating event network-vif-unplugged:7cbd2023-a83e-445a-b3a8-6aadb6c3c59c for instance 4659e047-b384-4220-b0d3-26e9f67354c5 on hv-cinder-83602 Sep 01 05:32:16.756515 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.760649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-b0507835-5bc0-4a27-a24d-c31c4caf1ecf req-74ad6f10-6488-4ae8-a47e-005d8b616111 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077085 Sep 01 05:32:16.761582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 204/407] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:16.779419 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.781754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:16.783006 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c34d431c-fcdc-47d6-ab12-c866d79a25bf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1721 microversion: 2.20 time: 0.193171 Sep 01 05:32:16.784007 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 204/408] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:16 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:17.272831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:17.273657 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:17.288123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.288668 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.294102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.294102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.294102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.294102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.527561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:17.536971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-161e1fa5-e657-4143-9a62-763efc18cbe2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1556 microversion: 2.1 time: 0.271179 Sep 01 05:32:17.537784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 205/409] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:17 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1556 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:17.559429 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:17.560535 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:17.573829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.573829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.573829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.573829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.574354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.574354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.664343 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-bde7c7f3-568c-46df-9db8-4a73cec2a3a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108897 Sep 01 05:32:17.665169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 205/410] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 05:32:17 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:17.811463 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:17.812294 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:17.818971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.819723 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.820247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:17.821104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:17.821718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:17.822356 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.047054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:18.055132 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:18.056821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:18.057970 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-70954be2-dd62-4019-ad23-1f249788cdd2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1724 microversion: 2.20 time: 0.250680 Sep 01 05:32:18.062789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 206/411] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:17 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:18.082500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3346b174-c710-4575-86b8-b31b22ead05e"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:18.084864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:18.091456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.091946 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.092560 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.093260 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.093716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.094140 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.848594 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-d27ec314-9f25-4b28-9066-3eea87771766 req-ffc26eaa-af5f-4a1f-b7ca-047c3ca120a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5080257c-de42-42cc-8244-50ab47c0e94e", "tag": "949d3bbf-73a4-48d0-bf61-aae262058036"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:18.859045 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d27ec314-9f25-4b28-9066-3eea87771766 req-ffc26eaa-af5f-4a1f-b7ca-047c3ca120a6 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:18.859803 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d27ec314-9f25-4b28-9066-3eea87771766 req-ffc26eaa-af5f-4a1f-b7ca-047c3ca120a6 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:18.860340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d27ec314-9f25-4b28-9066-3eea87771766 req-ffc26eaa-af5f-4a1f-b7ca-047c3ca120a6 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:18.888268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-d27ec314-9f25-4b28-9066-3eea87771766 req-ffc26eaa-af5f-4a1f-b7ca-047c3ca120a6 service nova] Creating event network-changed:949d3bbf-73a4-48d0-bf61-aae262058036 for instance 5080257c-de42-42cc-8244-50ab47c0e94e on hv-cinder-83602 Sep 01 05:32:18.893724 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-d27ec314-9f25-4b28-9066-3eea87771766 req-ffc26eaa-af5f-4a1f-b7ca-047c3ca120a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049411 Sep 01 05:32:18.894329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 207/412] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:19.273959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e39850e2-4b02-4f5d-b087-a20fb14c6edb tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.195426 Sep 01 05:32:19.274758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 206/413] 10.222.0.16 () {62 vars in 1364 bytes} [Thu Sep 1 05:32:18 2022] POST /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments => generated 188 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:32:19.419898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:19.421104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:19.428436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.429017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.429523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.430322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.430883 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.431381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.483855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121031) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:32:19.752655 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-95278de9-92a0-40ba-8937-1ab707f23c75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/action" status: 202 len: 0 microversion: 2.20 time: 0.339333 Sep 01 05:32:19.752655 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 208/414] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 1 05:32:19 2022] POST /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:32:19.760897 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:19.761497 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:19.767667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.768259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.768734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.769371 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:19.769808 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:19.770215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:19.966630 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.980365 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.982114 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:19.983323 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8355fdd4-9f91-457b-8632-82138a0ccc8d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1750 microversion: 2.20 time: 0.226479 Sep 01 05:32:19.998681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 207/415] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:19 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1750 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:21.009644 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:21.011036 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:21.018806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:21.019294 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:21.019725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.020419 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:21.020865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:21.021528 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:21.168950 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:21.179289 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:21.189116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:21.190575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c8feded9-4f24-4b6f-ad1b-d006286a7c1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1750 microversion: 2.20 time: 0.187504 Sep 01 05:32:21.191568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 209/416] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:21 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:22.214730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:22.215284 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:22.221469 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:22.221938 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:22.222363 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:22.223083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:22.223538 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:22.224017 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:22.356097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:22.364713 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:22.366131 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:22.367295 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c54f9eb6-f300-4053-ad4e-36c135b60222 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1752 microversion: 2.20 time: 0.156687 Sep 01 05:32:22.367841 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 208/417] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:22 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:23.390884 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:23.392245 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:23.399728 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:23.400889 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:23.401705 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:23.403497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:23.404167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:23.404870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:23.603627 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:23.613868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:23.615604 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:23.616836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fd84c20f-b36f-4116-aeaa-6827b86662fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1752 microversion: 2.20 time: 0.230560 Sep 01 05:32:23.617391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 210/418] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:23 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:24.644594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:24.645310 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:24.648762 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:24.654811 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:24.655521 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:24.656428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:24.657644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:24.658193 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:24.659090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:24.679094 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:24.809245 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:24.819203 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:24.820837 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:24.822427 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-04fe236e-97ca-41c7-8145-8ac32dfd92fa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.182485 Sep 01 05:32:24.823063 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 209/419] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:24 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:25.847925 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:25.848533 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:25.851094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:25.858727 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:25.859200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:25.859802 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:25.860684 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:25.861129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:25.873960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:26.067003 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:26.078215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:26.081155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:26.082717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d6e1427b-b7fb-41c0-aad1-8acf8d9bb09e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.238874 Sep 01 05:32:26.083719 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 211/420] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:25 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:27.107539 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:27.108195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:27.115796 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:27.116282 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:27.116703 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:27.117397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:27.117903 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:27.118324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:27.287224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:27.304610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:27.307510 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:27.312816 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f5df5c70-8d8b-44ca-bc44-5573ac9d3a01 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.209937 Sep 01 05:32:27.315268 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 210/421] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:27 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:28.337960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:28.339188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:28.346592 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:28.348716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:28.348716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:28.348716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:28.348716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:28.349032 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:28.541296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:28.552933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:28.555270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:28.556915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1c1d35a1-a392-4c0d-b2b1-c118a3b21198 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.222924 Sep 01 05:32:28.558812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 212/422] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:28 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:29.583660 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:29.584267 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:29.595287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:29.595777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:29.596216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:29.609214 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:29.609988 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:29.610783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:29.838634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:29.853122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:29.854808 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:29.858550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5d4dddbe-8da9-4db6-bbc0-efc3f4bd0603 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.278916 Sep 01 05:32:29.860849 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 211/423] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:29 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:30.885661 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:30.887290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:30.896042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:30.896657 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:30.897498 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:30.898291 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:30.898856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:30.899510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:31.130288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:31.155479 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:31.159151 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:31.163927 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5b28b388-5e1f-45a9-b944-7b5987242e03 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.283004 Sep 01 05:32:31.164982 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 213/424] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:30 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:32.194070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:32.195459 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:32.203915 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:32.204659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:32.205381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:32.206384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:32.207003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:32.207571 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:32.347677 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.357331 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.358865 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:32.360250 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0ba41256-4e2f-40a1-b6fa-b03ab58c4093 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.170878 Sep 01 05:32:32.360849 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 212/425] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:32 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:33.383736 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:33.384377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:33.391440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.391928 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.392348 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.393100 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:33.393572 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:33.393992 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:33.607181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.618317 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.648864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:33.648864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4974a501-bc25-4e41-aae1-3095ffc136ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.241489 Sep 01 05:32:33.648864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 214/426] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:33 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:34.045610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-726350229", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "networks": [{"uuid": "3fbdd801-9257-44ed-990e-fe6262ade395"}]}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:34.111208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] validate_networks() for [('3fbdd801-9257-44ed-990e-fe6262ade395', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:32:34.567645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:32:34.568254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:32:34.568923 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:32:34.569497 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:32:34.570075 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:32:34.580080 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.580839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.581441 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.582865 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.583385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.583986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.603731 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Getting quotas for project be72f5c9d9724a2a87a0a97c0d2d0cd8. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:32:34.609116 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Getting quotas for user 9d01f65308f544b79d9c65e57705d9b7 and project be72f5c9d9724a2a87a0a97c0d2d0cd8. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:32:34.621067 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:32:34.623776 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:32:34.673335 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:34.675008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:34.684136 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.685684 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.686340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.687463 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:34.687921 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:34.688397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:34.755602 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-46213fa8-eab1-4b5c-99cb-139cc51ace2d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713781 Sep 01 05:32:34.756981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 213/427] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:32:34.768347 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c10bce9f-e20a-4e1a-be39-6525cadc6be1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:34.769117 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c10bce9f-e20a-4e1a-be39-6525cadc6be1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:34.839239 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c10bce9f-e20a-4e1a-be39-6525cadc6be1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.870062 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c10bce9f-e20a-4e1a-be39-6525cadc6be1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1218 microversion: 2.1 time: 0.105531 Sep 01 05:32:34.870881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 214/428] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:34 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:34.930910 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.940399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.941864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:34.943079 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b872f447-b561-4a8e-8154-73204b74b8f3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.275957 Sep 01 05:32:34.946996 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 215/429] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:34 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:35.892949 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b9fc7e4e-2db0-4fd0-b160-7ca085fcfb8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:35.893729 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b9fc7e4e-2db0-4fd0-b160-7ca085fcfb8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:35.967731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:35.969808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:35.974565 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b9fc7e4e-2db0-4fd0-b160-7ca085fcfb8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:35.978015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:35.979372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:35.980594 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:35.981539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:35.982455 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:35.986831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:35.986952 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b9fc7e4e-2db0-4fd0-b160-7ca085fcfb8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1218 microversion: 2.1 time: 0.094835 Sep 01 05:32:35.986952 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 215/430] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:35 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:36.271454 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.278574 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:36.285775 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.287430 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:36.290573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bb88619e-78d2-4811-8043-b920159ea438 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.325564 Sep 01 05:32:36.290573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 216/431] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:35 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:37.014642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:37.014642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:37.014642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.014642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.015698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.015698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.015698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.015698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.082077 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.090256 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c2d6cf8e-4602-4fed-9c60-fd594453d337 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1222 microversion: 2.1 time: 0.089911 Sep 01 05:32:37.100701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 216/432] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:36 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:37.313355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:37.313956 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:37.326174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.326906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.327780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.334083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:37.334726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:37.335435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:37.544452 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.556202 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.558487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:37.560033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-67bd9e6e-15c6-4747-9043-8609a36b1016 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.250830 Sep 01 05:32:37.575910 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 217/433] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:37 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:38.111432 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:38.112027 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:38.119083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.119690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.120232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.121068 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.121650 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.122163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.190057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:38.198802 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-be62193c-039b-46d2-a1f9-8f7baa89e85b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1270 microversion: 2.1 time: 0.090901 Sep 01 05:32:38.199382 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 217/434] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:38 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:38.592421 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:38.594006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:38.606098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.607685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.608565 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.609545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:38.610102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:38.610671 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:38.842033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:38.856563 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:38.865576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:38.867440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-abe89551-5f34-40db-9044-059498a69627 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.281150 Sep 01 05:32:38.868563 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 218/435] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:38 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:39.224324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:39.225557 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:39.247450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.247979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.248426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.251368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.252609 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.253039 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.324584 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:39.342630 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2ee9b8f4-66b0-42f0-bc63-cbe05d0904e3 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1288 microversion: 2.1 time: 0.125289 Sep 01 05:32:39.343221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 218/436] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:39 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1288 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:39.891936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:39.894245 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:39.902509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.907224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.907224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:39.907224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:39.907224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:39.907567 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.075272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.084454 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.086186 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.087410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-54cda923-821a-4d8f-92fe-359c282b5c00 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.200018 Sep 01 05:32:40.087978 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 219/437] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:39 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:40.379883 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:40.384002 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:40.403468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.408717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.410350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.411386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.412090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.412734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.618985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:40.634300 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b07f6e1d-7340-4eed-a0ad-94cbc6528453 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1318 microversion: 2.1 time: 0.264605 Sep 01 05:32:40.639342 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 219/438] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:40 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:40.868079 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-7e90bdc8-26fc-4baa-a6d6-92bfd4b8a853 req-affa3424-43b8-4ca9-94ea-c1efb6a7ed66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e673fbc6-81ca-45da-8e45-a2dde14a5df1", "tag": "62acfc85-a052-4d6f-9355-f32323f5b35d"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:40.880683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-7e90bdc8-26fc-4baa-a6d6-92bfd4b8a853 req-affa3424-43b8-4ca9-94ea-c1efb6a7ed66 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:40.881268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-7e90bdc8-26fc-4baa-a6d6-92bfd4b8a853 req-affa3424-43b8-4ca9-94ea-c1efb6a7ed66 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:40.881954 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-7e90bdc8-26fc-4baa-a6d6-92bfd4b8a853 req-affa3424-43b8-4ca9-94ea-c1efb6a7ed66 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:40.895906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-7e90bdc8-26fc-4baa-a6d6-92bfd4b8a853 req-affa3424-43b8-4ca9-94ea-c1efb6a7ed66 service nova] Creating event network-changed:62acfc85-a052-4d6f-9355-f32323f5b35d for instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 on hv-cinder-83602 Sep 01 05:32:40.902907 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-7e90bdc8-26fc-4baa-a6d6-92bfd4b8a853 req-affa3424-43b8-4ca9-94ea-c1efb6a7ed66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047553 Sep 01 05:32:40.903774 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 220/439] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:41.113009 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:41.113620 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:41.119742 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.120854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.121304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.121987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.122461 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.123058 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.275181 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.285115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.286884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.288264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2b45f18a-1c8a-48bb-aa68-99613cd91be5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.179155 Sep 01 05:32:41.289135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 220/440] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:41 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:41.663130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:41.663977 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:41.671294 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.672106 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.673259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.674155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:41.674783 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:41.675902 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:41.832231 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:41.841283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f8f8b37d-dab8-489e-8f33-15f2df9f39c5 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1318 microversion: 2.1 time: 0.183517 Sep 01 05:32:41.841950 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 221/441] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:41 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:42.318743 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:42.320641 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:42.329208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.330058 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.330644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.331436 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.332096 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.332762 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.672448 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.709645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.711207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:42.716034 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a8c67c45-e592-4974-9dd3-6e0c676f02d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.404885 Sep 01 05:32:42.727426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 221/442] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:42 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:42.863225 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:42.863861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:42.872429 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.872915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.873340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:42.874026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:42.874664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:42.875230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.051031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.060240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ad795929-b244-4cd9-b95e-92a870159e0b tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1318 microversion: 2.1 time: 0.202569 Sep 01 05:32:43.061781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 222/443] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:42 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:43.738773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:43.739372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:43.746132 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.746644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.747073 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.747766 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:43.748212 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:43.748624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:43.914355 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.923934 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.925787 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:43.927210 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d59ba092-795e-4e78-a878-ead6128093ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.192381 Sep 01 05:32:43.927806 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 222/444] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:43 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:44.081169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:44.081700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:44.089534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.090024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.090604 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.091615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.092238 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.093116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.290944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:44.299612 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-def623b2-926b-479d-908a-d061128479ec tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1318 microversion: 2.1 time: 0.222384 Sep 01 05:32:44.300437 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 223/445] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:44 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:44.951813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:44.952667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:44.954861 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:44.960483 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.961235 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.962987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:44.962987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:44.964410 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:44.964959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.136555 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.145651 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.148371 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.149560 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f675771b-3797-45de-a833-a267f24762c9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.202856 Sep 01 05:32:45.150125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 223/446] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:44 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:45.320926 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:45.321474 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:45.329400 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.330344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.330818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.331521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:45.331964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:45.332375 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:45.524329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:45.532508 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-12094d5f-1e3f-42a1-a05a-b14fa483bb06 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1318 microversion: 2.1 time: 0.215532 Sep 01 05:32:45.533537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 224/447] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:45 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:46.171882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:46.172566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:46.178839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=10 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:46.180947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.181437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.181875 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.182633 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.183250 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.183857 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.330462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.340629 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.342172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.343457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e3187a74-ab44-485c-bc00-5a6a39352a2c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.175497 Sep 01 05:32:46.344104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 224/448] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:46 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:46.555585 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:46.557578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:46.564830 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.565473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.566059 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.566941 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:46.578582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:46.581722 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:46.799338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:46.808662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5d6decfa-ee1c-4973-8c3a-6473107eb369 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1318 microversion: 2.1 time: 0.259294 Sep 01 05:32:46.809237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 225/449] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:46 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:47.193298 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-f4a6e2ee-7203-4677-af4f-7c8eb97c22ea req-0e861ca2-ba21-4c1f-a4f0-700924c05b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e673fbc6-81ca-45da-8e45-a2dde14a5df1", "name": "network-vif-plugged", "status": "completed", "tag": "62acfc85-a052-4d6f-9355-f32323f5b35d"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:47.218456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f4a6e2ee-7203-4677-af4f-7c8eb97c22ea req-0e861ca2-ba21-4c1f-a4f0-700924c05b97 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.218959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f4a6e2ee-7203-4677-af4f-7c8eb97c22ea req-0e861ca2-ba21-4c1f-a4f0-700924c05b97 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.219438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f4a6e2ee-7203-4677-af4f-7c8eb97c22ea req-0e861ca2-ba21-4c1f-a4f0-700924c05b97 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.234815 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-f4a6e2ee-7203-4677-af4f-7c8eb97c22ea req-0e861ca2-ba21-4c1f-a4f0-700924c05b97 service nova] Creating event network-vif-plugged:62acfc85-a052-4d6f-9355-f32323f5b35d for instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 on hv-cinder-83602 Sep 01 05:32:47.244099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-f4a6e2ee-7203-4677-af4f-7c8eb97c22ea req-0e861ca2-ba21-4c1f-a4f0-700924c05b97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054731 Sep 01 05:32:47.244839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 225/450] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:47.367267 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:47.367984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:47.377561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.378155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.378658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.379445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.379929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.380556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.580801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.602232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.606070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:47.607613 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-71479730-0fc1-4e06-9fab-b8e28d79e811 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.245092 Sep 01 05:32:47.623995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 226/451] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:47 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:47.829509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:47.830218 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:47.842026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.842543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.842980 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:47.843682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:47.844132 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:47.844567 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.012011 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.024497 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1c53fefc-a599-4744-8c33-24a5f9667570 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1318 microversion: 2.1 time: 0.198723 Sep 01 05:32:48.025513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 226/452] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:47 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:48.633385 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:48.636503 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:48.653083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.657370 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.662105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.663212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:48.665428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:48.666042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:48.873896 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.884270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.886272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:48.887472 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-83a69381-bb24-47d8-b16f-5461131580cf tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.259966 Sep 01 05:32:48.904973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 227/453] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:48 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:49.047106 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:49.047686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:49.057649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.058112 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.058604 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.063367 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.064158 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.068740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.286081 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-5ee94bc8-2449-4f33-8431-7944a4a897ca req-9f3f8395-8b29-4c05-a03b-8d683679e591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4659e047-b384-4220-b0d3-26e9f67354c5", "name": "network-vif-plugged", "status": "completed", "tag": "7cbd2023-a83e-445a-b3a8-6aadb6c3c59c"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:49.300587 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-5ee94bc8-2449-4f33-8431-7944a4a897ca req-9f3f8395-8b29-4c05-a03b-8d683679e591 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.301070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-5ee94bc8-2449-4f33-8431-7944a4a897ca req-9f3f8395-8b29-4c05-a03b-8d683679e591 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.301500 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-5ee94bc8-2449-4f33-8431-7944a4a897ca req-9f3f8395-8b29-4c05-a03b-8d683679e591 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.303123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:49.314743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-5ee94bc8-2449-4f33-8431-7944a4a897ca req-9f3f8395-8b29-4c05-a03b-8d683679e591 service nova] Creating event network-vif-plugged:7cbd2023-a83e-445a-b3a8-6aadb6c3c59c for instance 4659e047-b384-4220-b0d3-26e9f67354c5 on hv-cinder-83602 Sep 01 05:32:49.317482 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a6f8dc4a-4792-417c-82b9-adaea804ac62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1318 microversion: 2.1 time: 0.274898 Sep 01 05:32:49.321959 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-5ee94bc8-2449-4f33-8431-7944a4a897ca req-9f3f8395-8b29-4c05-a03b-8d683679e591 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039837 Sep 01 05:32:49.322598 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 228/454] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:49.331686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 227/455] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:49 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:49.911441 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:49.912810 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:49.923509 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.924256 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.924871 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:49.925931 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:49.926601 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:49.927185 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.039164 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:32:50.039599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:32:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 (ip 10.222.0.16) !!! Sep 01 05:32:50.129980 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.141676 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.143176 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.144367 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-febef820-16ab-4e8d-85bc-ae927e1248d5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.237423 Sep 01 05:32:50.144920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 229/456] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:49 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:50.339777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:50.341183 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:50.348430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:50.348936 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:50.349355 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.350086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:50.350571 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:50.350993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:50.498999 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:50.506817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-353def54-257e-462b-b596-9d2a0540542e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1506 microversion: 2.1 time: 0.171457 Sep 01 05:32:50.507381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 228/457] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:50 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:51.168962 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:51.170628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:51.177800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.178398 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.178988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.179682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:51.180293 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:51.180874 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:51.386715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.402595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.402595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:51.408143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dcc80e85-39d8-44ba-9110-b2b32cca66ca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.243764 Sep 01 05:32:51.408937 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 230/458] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:51 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:32:52.433210 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:52.434701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:52.442059 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.442597 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.443035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.443730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:52.444467 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:52.445193 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:52.467461 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:52.689182 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:52.704409 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:52.715524 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:52.717532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-69be00cc-d241-42e7-8d9a-97f24cd3def6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.289452 Sep 01 05:32:52.718614 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 229/459] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:52 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:53.741624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:53.742369 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:53.749521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.750137 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.750790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.752765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:53.753216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:53.753885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:53.902710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.912556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.914761 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:53.917278 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b1cd8888-fd95-4f5a-bd9b-c852ecae6c1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.178870 Sep 01 05:32:53.933515 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 231/460] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:53 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:54.941355 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:54.942092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:54.952895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.953392 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.953830 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:54.954646 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:54.955255 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:54.955684 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.047558 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:55.048836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.058298 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.059726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.060418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.061369 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.062303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.064630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.098259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d67b86e0-bcad-48a1-b3e7-4ad727d185b9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e/ips" status: 200 len: 149 microversion: 2.1 time: 0.055728 Sep 01 05:32:55.105966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 232/461] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:32:55 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e/ips => generated 149 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:55.111639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d434ac8-0398-4e29-ac13-8de1d30fc9d8"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:55.114324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.123788 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.124900 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.125378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.126290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.126775 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.127193 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.129628 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.144094 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.148470 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:55.150091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1ad106b9-7c6c-48ab-a525-f59dbb457ac3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.212801 Sep 01 05:32:55.151772 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 230/462] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:54 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:55.225900 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Invalid volume: volume 3d434ac8-0398-4e29-ac13-8de1d30fc9d8 is already attached to instances: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: POST /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e/os-volume_attachments HTTP/1.1 Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 74 Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:32:55.227720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {"volumeAttachment": {"volumeId": "3d434ac8-0398-4e29-ac13-8de1d30fc9d8"}} Sep 01 05:32:55.229350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Invalid volume: volume 3d434ac8-0398-4e29-ac13-8de1d30fc9d8 is already attached to instances: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'server_id': '5080257c-de42-42cc-8244-50ab47c0e94e', 'body': {'volumeAttachment': {'volumeId': '3d434ac8-0398-4e29-ac13-8de1d30fc9d8'}}} Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3d434ac8-0398-4e29-ac13-8de1d30fc9d8 is already attached to instances: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:32:55.230332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3d434ac8-0398-4e29-ac13-8de1d30fc9d8 is already attached to instances: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:32:55.231831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:32:55.233305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:32:55.233305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:32:55.233305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:32:55.233305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3d434ac8-0398-4e29-ac13-8de1d30fc9d8 is already attached to instances: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff Sep 01 05:32:55.233305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:32:55.233305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 400 to user: Invalid volume: volume 3d434ac8-0398-4e29-ac13-8de1d30fc9d8 is already attached to instances: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:32:55.233305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-83fc2769-27b8-4a6a-9380-35ac14221624 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.121737 Sep 01 05:32:55.238525 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:55.239064 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.242032 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 233/463] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:32:55 2022] POST /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:32:55.245927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.246665 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.247364 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.248036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.248489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.248909 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.277359 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:32:55.889637 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-122bb48f-5071-49fe-a11d-180cb8ddfa17 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 204 len: 0 microversion: 2.1 time: 0.654690 Sep 01 05:32:55.890945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 231/464] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:32:55 2022] DELETE /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 0 bytes in 657 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:32:55.899663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:55.900527 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:55.910255 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.913650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.913650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:55.913650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:55.913650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:55.914052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.075465 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:56.091062 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-519e8216-1997-480f-ba91-1aff1e5a2290 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1680 microversion: 2.1 time: 0.191545 Sep 01 05:32:56.091727 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 234/465] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:55 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:56.178123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:56.179593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:56.186135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.186648 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.187076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.187763 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:56.188205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:56.188623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:56.341200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:56.350283 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:56.351775 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:56.352944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-92610b59-72b0-4472-801b-710e02881d2f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.179640 Sep 01 05:32:56.354487 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 232/466] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:56 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:57.112332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:57.113620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:57.117266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=48 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:57.121535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.126328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.126813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.128820 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.128820 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.128820 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.132934 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:57.284122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.284122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b9b2b2b3-ca22-42b3-ad4a-774175058154 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1680 microversion: 2.1 time: 0.171950 Sep 01 05:32:57.284122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 235/467] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:57 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:57.376160 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:57.376721 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:57.379088 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:32:57.383819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.384291 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.384740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.385417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:57.385855 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:57.386268 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:57.525550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.534418 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.535878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:57.537020 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-eb3cedf0-109d-4594-bd69-ad6de6158ed9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.164858 Sep 01 05:32:57.537575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 233/468] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:57 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:57.661579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d5981daf-bfae-4929-bb50-e0b8c6ee251c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Action: 'create', calling method: .version_select at 0x7f953b1245e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-844308784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT8WKcCBgaq9G2x55qrwqyszJoVjAFAjDWKLsIld7mL52SPvlhRRbQq6cEwo+F+9DJwVoFSW2kO8pK90VCSWvlZ/sPeBFkQ+Iv/fdAhWriIHqsX2SZk3jHrIFZDUVbf/Q=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:57.677542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-d5981daf-bfae-4929-bb50-e0b8c6ee251c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Getting quotas for project 924b0db81eb1479e9bea0f8a60d66526. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:32:57.683901 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-d5981daf-bfae-4929-bb50-e0b8c6ee251c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Getting quotas for user 4e9d9a240b824236aa40a3d03922b51d and project 924b0db81eb1479e9bea0f8a60d66526. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:32:57.748326 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d5981daf-bfae-4929-bb50-e0b8c6ee251c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.090552 Sep 01 05:32:57.749150 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 236/469] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:32:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:57.803125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-978331714", "imageRef": "7ebde36c-04f2-413f-8974-8e4046a69322", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-844308784", "networks": [{"uuid": "d26c7bf2-86d8-4281-8dd6-56b8ae654f5f"}]}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:58.301804 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:58.302579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:58.309067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.316893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.316893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.316893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.316893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.317310 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.484183 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.492985 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4df7fa39-306e-4663-91a3-f34c46fd9b53 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1680 microversion: 2.1 time: 0.195622 Sep 01 05:32:58.495974 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 237/470] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:58 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:32:58.564616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:58.565780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:58.573290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.575974 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.576428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.577174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.577637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.578096 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.789092 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.799626 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.801403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:58.802998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4772fa8f-432f-40f0-af88-3856ecfe93d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1808 microversion: 2.20 time: 0.246918 Sep 01 05:32:58.803555 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 238/471] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:58 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:32:58.920002 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-e26609ae-afe6-4db5-bbf5-8b00f14fdd12 req-b0dea43f-3668-41d9-88c0-1fa6fbcefed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5080257c-de42-42cc-8244-50ab47c0e94e", "name": "network-vif-deleted", "tag": "949d3bbf-73a4-48d0-bf61-aae262058036"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:32:58.930713 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e26609ae-afe6-4db5-bbf5-8b00f14fdd12 req-b0dea43f-3668-41d9-88c0-1fa6fbcefed2 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:58.934204 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e26609ae-afe6-4db5-bbf5-8b00f14fdd12 req-b0dea43f-3668-41d9-88c0-1fa6fbcefed2 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:58.934204 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e26609ae-afe6-4db5-bbf5-8b00f14fdd12 req-b0dea43f-3668-41d9-88c0-1fa6fbcefed2 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:58.944890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-e26609ae-afe6-4db5-bbf5-8b00f14fdd12 req-b0dea43f-3668-41d9-88c0-1fa6fbcefed2 service nova] Creating event network-vif-deleted:949d3bbf-73a4-48d0-bf61-aae262058036 for instance 5080257c-de42-42cc-8244-50ab47c0e94e on hv-cinder-83602 Sep 01 05:32:58.950786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-e26609ae-afe6-4db5-bbf5-8b00f14fdd12 req-b0dea43f-3668-41d9-88c0-1fa6fbcefed2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038910 Sep 01 05:32:58.951395 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 239/472] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:32:59.159655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] validate_networks() for [('d26c7bf2-86d8-4281-8dd6-56b8ae654f5f', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:32:59.518143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:59.519487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:59.526656 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.527445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.528139 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.529777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.530247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.530691 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.575291 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.576011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.576591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.577266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lazy-loading 'fault' on Instance uuid 5080257c-de42-42cc-8244-50ab47c0e94e {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:32:59.620891 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:32:59.621593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:32:59.622315 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:32:59.622952 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:32:59.623521 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:32:59.636086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.636782 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.637584 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.639433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.640045 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.640429 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.641964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:59.653102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2085f62a-dee6-46f2-bcbd-f25e730e6931 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 200 len: 1330 microversion: 2.1 time: 0.139542 Sep 01 05:32:59.662175 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Getting quotas for project 924b0db81eb1479e9bea0f8a60d66526. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:32:59.667357 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 240/473] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:59 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 1330 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:32:59.669297 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Getting quotas for user 4e9d9a240b824236aa40a3d03922b51d and project 924b0db81eb1479e9bea0f8a60d66526. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:32:59.685639 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:32:59.688403 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7ebde36c-04f2-413f-8974-8e4046a69322',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:32:59.828034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:59.829287 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:59.838719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9afbe6fd-1927-417d-9071-ba9e2f349937 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039697 Sep 01 05:32:59.839833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.840220 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 234/474] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:32:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:32:59.842859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.843522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.844430 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:32:59.845028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:32:59.845644 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:32:59.855076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ea36ce86-1223-4dbe-acc8-4f259d1fb9f8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:32:59.857007 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ea36ce86-1223-4dbe-acc8-4f259d1fb9f8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:32:59.936882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ea36ce86-1223-4dbe-acc8-4f259d1fb9f8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:32:59.956224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ea36ce86-1223-4dbe-acc8-4f259d1fb9f8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1257 microversion: 2.1 time: 0.108965 Sep 01 05:32:59.957075 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 235/475] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:32:59 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1257 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:00.069045 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.085485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.087478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:00.089089 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-10d80989-eaed-4502-a101-2c2bd2e1b1c2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1795 microversion: 2.20 time: 0.267001 Sep 01 05:33:00.105938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 241/476] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:32:59 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1795 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:00.259381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cff3c4c-3af6-41d4-aae9-ba992af79c3f"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:00.261873 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:00.267965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.268859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.269488 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.270487 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.271088 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.271691 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.675425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:00.676129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:00.683623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.684124 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.684744 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.685513 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:00.688146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:00.688620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:00.708082 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e HTTP/1.1 Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:33:00.709757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:33:00.711447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '5080257c-de42-42cc-8244-50ab47c0e94e'} Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:00.712350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:33:00.714192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:00.715485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:00.715485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8ff32086-e46e-4c82-a2f1-6a053f907263 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 404 len: 111 microversion: 2.1 time: 0.040482 Sep 01 05:33:00.715485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 242/477] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:00 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:33:00.721051 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5ee43f7d-06cf-4f4d-812b-12924ff318c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '.version_select at 0x7f953b0721f0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:00.810399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5ee43f7d-06cf-4f4d-812b-12924ff318c0 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-883759414" status: 202 len: 0 microversion: 2.1 time: 0.093004 Sep 01 05:33:00.811028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 243/478] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 1 05:33:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-883759414 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:33:00.980232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d3654665-1b34-4f5a-bba7-9e1b237b5329 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:00.980765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d3654665-1b34-4f5a-bba7-9e1b237b5329 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:01.048274 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d3654665-1b34-4f5a-bba7-9e1b237b5329 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:01.057907 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d3654665-1b34-4f5a-bba7-9e1b237b5329 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1257 microversion: 2.1 time: 0.080227 Sep 01 05:33:01.057907 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 244/479] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:00 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:01.241768 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3abaf0e1-ff6c-439f-b3d7-8db365325bc6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.986402 Sep 01 05:33:01.242567 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 236/480] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:33:00 2022] POST /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments => generated 194 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:01.755073 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:01.755734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:01.762478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.767269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.767269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.767269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:01.767269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:01.767635 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:01.904368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lazy-loading 'services' on Instance uuid 6e4956c0-5c09-4733-a34a-a06dfb38a0ff {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:02.079296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:02.079966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:02.087184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.088414 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.088896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.089625 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.090114 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.090566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.159594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:02.168181 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7b56ad08-cf37-4967-92db-01a2b97ce9c5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1309 microversion: 2.1 time: 0.093229 Sep 01 05:33:02.168756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 237/481] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:02 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:02.203428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-54e5a16f-6e28-449d-8f0a-5941a36a5f2e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments/3d434ac8-0398-4e29-ac13-8de1d30fc9d8" status: 202 len: 0 microversion: 2.1 time: 0.452189 Sep 01 05:33:02.204251 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 245/482] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:33:01 2022] DELETE /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments/3d434ac8-0398-4e29-ac13-8de1d30fc9d8 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:33:02.215035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:02.217380 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:02.224709 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.225196 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.225641 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.226332 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:02.226814 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:02.227232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:02.260299 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7088bebf-bdac-450b-8bda-9dfba56f73dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051563 Sep 01 05:33:02.261073 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 238/483] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:02 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:03.189829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:03.190559 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:03.197493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.197968 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.198542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.199261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.199713 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.200133 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.273878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:03.278169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:03.279527 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:03.290299 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-41423c8f-e424-43a2-a872-97a3fce072ae tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1327 microversion: 2.1 time: 0.102425 Sep 01 05:33:03.290522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.290522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.290522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.292505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:03.293259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:03.295107 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:03.301898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 246/484] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:03 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:03.325738 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d1c9a47d-c44d-48fa-845c-e7a41d34c620 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057787 Sep 01 05:33:03.326503 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 239/485] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:03 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:04.309768 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:04.310376 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:04.317288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.317790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.318262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.318984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.319431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.319849 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.338667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:04.342775 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:04.350031 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.350031 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.351183 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.352566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:04.353988 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:04.354696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:04.397829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8d34a018-5433-49bb-9f91-4cb98bcd401c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064396 Sep 01 05:33:04.403289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 240/486] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:04 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:04.471661 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:04.480379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-498c4650-4ba2-4d84-8532-05db4ea624aa tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.174985 Sep 01 05:33:04.491259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 247/487] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:04 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:05.411232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:05.413961 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:05.421242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.421740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.422173 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.422894 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.423347 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.423769 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.455946 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-32aa09b4-3475-4bce-9e49-1fa6c3d01fa9 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048877 Sep 01 05:33:05.456508 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 241/488] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:05 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:05.502253 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:05.502892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:05.509318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.509795 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.510223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.510937 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:05.511382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:05.511799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:05.900650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:05.909145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c62b1ecb-9905-45fc-8585-f30c0682cd31 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.411148 Sep 01 05:33:05.909849 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 248/489] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:05 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:06.468329 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:06.470376 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:06.476846 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:06.477325 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:06.478252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:06.479035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:06.479484 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:06.479904 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:06.514171 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2768d3b2-493d-44f7-ac63-4bedb2a8e113 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049795 Sep 01 05:33:06.514819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 242/490] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:06 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:06.930997 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:06.932223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:06.938550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:06.939026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:06.939453 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:06.940165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:06.940607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:06.941022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:07.080939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:07.090459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-68f34306-86e5-4e05-97cd-ea3734e522b9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.163920 Sep 01 05:33:07.091074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 249/491] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:06 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:07.528749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:07.530906 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:07.537306 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:07.537947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:07.538236 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:07.538956 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:07.539404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:07.540047 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:07.571078 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ecc8fc3a-9833-4127-99e1-23a170021336 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Sep 01 05:33:07.571883 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 243/492] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:07 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:08.111709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:08.112314 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:08.118733 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.119201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.119623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.120473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.120961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.121370 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.272769 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:08.281204 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e44bb87b-8433-4a7b-964a-d60c35670d07 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.173065 Sep 01 05:33:08.281941 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 250/493] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:08 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:08.458706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "166403eb-af30-41d2-a5ba-cc5868e8b64f", "device": "/dev/sdb"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:08.461545 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:08.468143 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.468633 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.469311 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.470010 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.470479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.470903 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.549162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:08.583327 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:08.585532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:08.592383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.592852 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.593270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.593980 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:08.594440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:08.594847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:08.625255 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4e63cfac-584e-4b79-975a-6cd1a1564a3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Sep 01 05:33:08.625821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 251/494] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:08 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:09.302520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:09.303270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:09.310380 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:09.310883 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:09.311308 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:09.311987 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:09.312421 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:09.312828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:09.448957 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:09.457048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a68d4d57-608f-4f44-a8a1-a3a7dda4f577 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.158331 Sep 01 05:33:09.457620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 252/495] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:09 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:09.637462 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:09.639720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:09.645953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:09.646476 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:09.646903 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:09.647575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:09.648020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:09.648431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:09.649923 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:09.679230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3edddb79-4b30-4799-9ea5-8f4135161089 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Sep 01 05:33:09.679783 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 253/496] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:09 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:09.940830 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=8 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:10.477817 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:10.478427 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:10.485568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:10.486038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:10.486500 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:10.487183 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:10.487674 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:10.488091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:10.621641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:10.629850 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-672eb806-ee05-4971-83ee-698fc402f949 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.155642 Sep 01 05:33:10.631317 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 254/497] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:10 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:10.692667 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:10.695222 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:10.701460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:10.701945 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:10.702352 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:10.703104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:10.703549 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:10.703985 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:10.708786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:10.735845 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-01dcd889-cd6f-426d-88fb-c9b845548930 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047482 Sep 01 05:33:10.736655 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 255/498] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:10 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:11.657167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:11.658789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:11.664920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:11.667428 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.668146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.668928 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.669844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.670516 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.671137 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.817730 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:11.826123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-907cc52a-641d-4088-a399-fa24acd15210 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.173384 Sep 01 05:33:11.826767 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 256/499] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:11 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:11.831532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:11.833638 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:11.840523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.841065 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.841502 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.842201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:11.842675 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:11.843094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:11.874680 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-05d2a43a-80d2-4805-b631-ef0fafe45543 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Sep 01 05:33:11.875441 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 257/500] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:11 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:12.846485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:12.847188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:12.855102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:12.855575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:12.856004 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:12.856707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:12.857157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:12.857700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:12.988610 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:12.996831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1a709bb5-4d4e-4672-9531-925690c08d95 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.154200 Sep 01 05:33:12.997382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 258/501] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:12 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:13.001813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:13.003944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:13.009420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:13.009895 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:13.010315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:13.011016 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:13.011455 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:13.011867 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:13.040514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1258557c-0c1e-4649-a924-f0663153f5ef tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Sep 01 05:33:13.041787 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 259/502] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:12 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:14.017246 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:14.017822 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:14.028916 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.028916 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.028916 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.028916 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.029399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.029399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.200990 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:14.207519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f0911a39-25d1-4de6-b2c3-7ebe4348656c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.194117 Sep 01 05:33:14.208075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 260/503] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:14 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:14.212776 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:14.215464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:14.221328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.221805 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.222237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.222964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.223523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.223854 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.253653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3fcf85e7-8b87-40cb-852a-d79dd9d1915a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044508 Sep 01 05:33:14.254213 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 261/504] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:14 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:14.278122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-8503490d-bf08-4e60-a5de-4dee648e7505 req-50b722ed-171f-4b1a-a99e-0ca105af3b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e5b578-ab03-48a7-9272-9432987ef817", "tag": "bd7c102d-defb-4763-8b8b-49ff53fc8472"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:14.287647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8503490d-bf08-4e60-a5de-4dee648e7505 req-50b722ed-171f-4b1a-a99e-0ca105af3b06 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:14.288122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8503490d-bf08-4e60-a5de-4dee648e7505 req-50b722ed-171f-4b1a-a99e-0ca105af3b06 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:14.288549 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8503490d-bf08-4e60-a5de-4dee648e7505 req-50b722ed-171f-4b1a-a99e-0ca105af3b06 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:14.300685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-8503490d-bf08-4e60-a5de-4dee648e7505 req-50b722ed-171f-4b1a-a99e-0ca105af3b06 service nova] Creating event network-changed:bd7c102d-defb-4763-8b8b-49ff53fc8472 for instance f5e5b578-ab03-48a7-9272-9432987ef817 on hv-cinder-83602 Sep 01 05:33:14.306011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-8503490d-bf08-4e60-a5de-4dee648e7505 req-50b722ed-171f-4b1a-a99e-0ca105af3b06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032272 Sep 01 05:33:14.307006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 262/505] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:14.693043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d2ea01c2-ba26-4905-91ff-aa02db1a52a1 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "POST /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.238192 Sep 01 05:33:14.693649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 244/506] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:33:08 2022] POST /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1/os-volume_attachments => generated 194 bytes in 6240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:15.185801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:15.188111 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:15.194188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.194686 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.200039 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.200039 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.200039 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.200039 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.221619 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'flavor' on Instance uuid 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:15.230399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:15.231325 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:15.238501 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.238987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.239417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.240106 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.240790 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.241370 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.378268 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:15.388219 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ef85c400-7738-41d8-aef9-a28f153e0bd5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.162845 Sep 01 05:33:15.390887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 245/507] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:15 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:15.396452 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:15.399174 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:15.405979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.406647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.407141 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.407891 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.408402 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.408881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.440383 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ce5755c0-6ddd-4755-a2b5-91913da31750 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050352 Sep 01 05:33:15.440926 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 246/508] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:15 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:15.583735 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-191462ba-424d-4b8c-b4b3-d0fdfdf5e4fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/action" status: 200 len: 32 microversion: 2.1 time: 0.403285 Sep 01 05:33:15.584252 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 263/509] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:33:15 2022] POST /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:33:15.594255 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:15.594916 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:15.601003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.603119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.603119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.603119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:15.603119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:15.604065 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:15.731216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:15.739592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-224f9847-6af2-48b8-bec2-ca9afdfcc3e3 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.149384 Sep 01 05:33:15.740161 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 247/510] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:15 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:16.411019 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:16.411701 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:16.418213 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.418705 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.419128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.419796 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.420231 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.420639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.453182 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:16.455672 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:16.463322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.463865 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.464339 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.465058 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.465588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.466029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.505655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b307e2b9-75b3-4381-ba5a-4e79d33639c4 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057194 Sep 01 05:33:16.506884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 248/511] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:16 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:16.582680 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:16.590125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b22ca6e3-89b0-4273-8919-efa36e1dbbcf tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.183802 Sep 01 05:33:16.590717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 264/512] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:16 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:16.760791 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:16.761326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:16.767272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.767701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.768129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.768798 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:16.769256 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:16.769669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:16.910196 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:16.919220 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f9105bf5-84dc-4914-803e-f057416edc88 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.162217 Sep 01 05:33:16.920430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 249/513] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:16 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:17.519901 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:17.522131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:17.529466 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.529940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.530396 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.531148 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.531582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.531998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.562203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-465211ac-7d2e-4113-b1f5-52a20e8e72ed tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046393 Sep 01 05:33:17.562807 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 265/514] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:33:17 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:33:17.612870 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:17.613555 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:17.620732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.621544 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.621907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.622701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.623253 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.623776 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.626558 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:17.627047 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:17.633352 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.634197 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.637593 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.638048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.638532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.639134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.666433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:33:17.772301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:17.779985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-46015974-6933-486f-a386-b6f8694c967b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.171204 Sep 01 05:33:17.780554 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 250/515] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:17 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:17.939937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:17.940531 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:17.946860 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.947944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.947944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.948464 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:17.948913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:17.949334 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:17.998084 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7727a2ab-a762-4d70-868e-1d3813f5d525 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 204 len: 0 microversion: 2.1 time: 0.375114 Sep 01 05:33:17.998712 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 266/516] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:33:17 2022] DELETE /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:33:18.007266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:18.008038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:18.014178 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.014883 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.015358 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.016034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.016597 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.017170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.084215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:18.092579 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2f75d4dc-ef23-470d-8dc0-d33bbe9af021 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.156428 Sep 01 05:33:18.093290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 251/517] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:17 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:18.145211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:18.152856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a72ac0d5-5bd1-4345-b3a4-f10f7d3a7c6b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1682 microversion: 2.1 time: 0.149873 Sep 01 05:33:18.153410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 267/518] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:18 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:18.802618 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:18.803292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:18.809764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.813135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.813135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.813135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:18.813135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:18.813528 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:18.950564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:18.959058 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4aa60abe-3e71-4a49-8cba-84dddff45ed2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.160588 Sep 01 05:33:18.959646 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 252/519] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:18 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:19.113270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:19.113844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:19.120770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.121239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.121662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.122337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.122805 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.123216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.173381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:19.173987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:19.180237 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.180720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.181146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.182323 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.182795 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.183388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.258252 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:19.262540 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:19.267624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c104169c-d520-497d-a356-8d493f3ba652 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.158492 Sep 01 05:33:19.268206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 268/520] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:19 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:19.316335 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:19.324907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4e6b695c-4b28-4e81-8489-c25eb0ee28a8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1682 microversion: 2.1 time: 0.155510 Sep 01 05:33:19.325468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 253/521] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:19 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:19.982023 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:19.982596 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:19.988931 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.989402 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.989831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:19.990538 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:19.990987 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:19.991432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.144894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:20.151375 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6ce26b5c-c38c-419e-8303-9549b32909d9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.174317 Sep 01 05:33:20.151947 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 269/522] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:19 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:20.289166 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:20.289893 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:20.296468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.296944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.297380 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.298061 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.298562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.298985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.345250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:20.345959 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:20.361737 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.362310 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.362833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.363606 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:20.364119 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:20.364601 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:20.451666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:20.459702 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2b3a06ab-eaf7-4326-a3cd-855ba2319989 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.174507 Sep 01 05:33:20.460259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 254/523] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:20 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:20.619608 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:20.627319 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-17caa2af-8a53-4537-96da-bf3c3ed98988 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1682 microversion: 2.1 time: 0.285829 Sep 01 05:33:20.627898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 270/524] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:20 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1682 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:21.062736 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-dd1b2028-fe96-4c9d-bfc1-e73f12063e69 req-1aa6ec1d-4d1d-43e8-aeb9-f8f1fc4d1f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e5b578-ab03-48a7-9272-9432987ef817", "name": "network-vif-plugged", "status": "completed", "tag": "bd7c102d-defb-4763-8b8b-49ff53fc8472"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:21.074308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-dd1b2028-fe96-4c9d-bfc1-e73f12063e69 req-1aa6ec1d-4d1d-43e8-aeb9-f8f1fc4d1f21 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.074975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-dd1b2028-fe96-4c9d-bfc1-e73f12063e69 req-1aa6ec1d-4d1d-43e8-aeb9-f8f1fc4d1f21 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.075403 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-dd1b2028-fe96-4c9d-bfc1-e73f12063e69 req-1aa6ec1d-4d1d-43e8-aeb9-f8f1fc4d1f21 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.092708 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-dd1b2028-fe96-4c9d-bfc1-e73f12063e69 req-1aa6ec1d-4d1d-43e8-aeb9-f8f1fc4d1f21 service nova] Creating event network-vif-plugged:bd7c102d-defb-4763-8b8b-49ff53fc8472 for instance f5e5b578-ab03-48a7-9272-9432987ef817 on hv-cinder-83602 Sep 01 05:33:21.097935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-dd1b2028-fe96-4c9d-bfc1-e73f12063e69 req-1aa6ec1d-4d1d-43e8-aeb9-f8f1fc4d1f21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041491 Sep 01 05:33:21.099152 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 255/525] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:21.149060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-c4659a35-86b3-4bbe-933c-ea221133e387 req-2fe922c0-8b7e-4415-8c7c-bee9211114e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4956c0-5c09-4733-a34a-a06dfb38a0ff", "name": "network-vif-deleted", "tag": "2270f934-97de-4f7e-b1b1-847058bb4fd1"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:21.161046 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c4659a35-86b3-4bbe-933c-ea221133e387 req-2fe922c0-8b7e-4415-8c7c-bee9211114e2 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.162281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c4659a35-86b3-4bbe-933c-ea221133e387 req-2fe922c0-8b7e-4415-8c7c-bee9211114e2 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.162281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c4659a35-86b3-4bbe-933c-ea221133e387 req-2fe922c0-8b7e-4415-8c7c-bee9211114e2 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.173443 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:21.174144 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:21.184277 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.193822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.194271 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.195413 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.195835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.196237 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.204002 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-c4659a35-86b3-4bbe-933c-ea221133e387 req-2fe922c0-8b7e-4415-8c7c-bee9211114e2 service nova] Creating event network-vif-deleted:2270f934-97de-4f7e-b1b1-847058bb4fd1 for instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff on hv-cinder-83602 Sep 01 05:33:21.209917 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-c4659a35-86b3-4bbe-933c-ea221133e387 req-2fe922c0-8b7e-4415-8c7c-bee9211114e2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064649 Sep 01 05:33:21.210968 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 271/526] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:21.347517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:21.356896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4fc47ee2-7e60-4713-b045-1c0be9d86d46 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.187961 Sep 01 05:33:21.370347 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 256/527] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:21 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:21.482731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:21.483534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:21.492883 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.493361 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.493783 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.494521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.494958 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.495367 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.628014 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:21.638328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-abe2b140-9a3e-4c5e-b5d0-24d41f25b8ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.159282 Sep 01 05:33:21.638328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 272/528] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:21 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:21.648536 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:21.649240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:21.656219 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.657036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.657664 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.658374 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.658849 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.659258 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.691506 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:21.691968 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:21.692390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:21.692823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lazy-loading 'fault' on Instance uuid 6e4956c0-5c09-4733-a34a-a06dfb38a0ff {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:21.741447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:21.750743 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c3a63295-f913-4a47-861a-95a1a323ed80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1332 microversion: 2.1 time: 0.105408 Sep 01 05:33:21.751722 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 257/529] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:21 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:22.377258 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:22.377855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:22.384064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.384532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.385589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.386254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.386715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.387126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.513813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:22.521535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f3eaf6e7-73b1-4de3-9fe8-0d7a61b04b91 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1357 microversion: 2.1 time: 0.148071 Sep 01 05:33:22.522093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 273/530] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:22 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:22.658493 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:22.659099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:22.665421 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.665893 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.666319 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.667025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.667472 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.667888 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.771957 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:22.772567 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:22.774693 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:22.779929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.780442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.780864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.784791 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.784791 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.784791 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.801578 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:22.810922 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-26f835a4-8d7e-4d3b-b319-e4f82eaa564a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.156212 Sep 01 05:33:22.811558 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 258/531] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:22 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:22.820064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:22.820534 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:22.820952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:22.821558 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lazy-loading 'fault' on Instance uuid 6e4956c0-5c09-4733-a34a-a06dfb38a0ff {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:22.861435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:22.869391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-826a73ea-45f7-4e92-9cd0-b45acd40ffeb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 200 len: 1332 microversion: 2.1 time: 0.100905 Sep 01 05:33:22.869969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 274/532] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:22 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:23.542468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:23.543099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:23.549209 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.549681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.550127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.550827 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.551271 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.551686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.686999 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:23.694825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cf3d5f8d-c575-48d0-aefe-aaa322b804d6 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1548 microversion: 2.1 time: 0.156002 Sep 01 05:33:23.695387 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 259/533] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:23 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:23.715970 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:23.716620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:23.723053 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.723516 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.723935 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.724601 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.725038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.725448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.837308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:23.838038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:23.844831 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.845352 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.845790 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.846517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.846974 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.847398 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.866689 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:23.870136 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:23.875625 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-80b5666b-850f-4b3c-88d7-c02d2dd984a1 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1548 microversion: 2.1 time: 0.163737 Sep 01 05:33:23.876288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 275/534] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:23 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:23.891077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:23.891998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:23.898687 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.899241 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.899739 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.900431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.900882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.901341 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.919911 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff HTTP/1.1 Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:33:23.921662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:33:23.923077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '6e4956c0-5c09-4733-a34a-a06dfb38a0ff'} Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:23.923855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:33:23.925122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:23.926243 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:23.926243 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e7c42033-589f-4f9b-a566-2ee1cdc47e40 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 404 len: 111 microversion: 2.1 time: 0.036907 Sep 01 05:33:23.927586 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 276/535] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:23 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:33:23.933614 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:23.939357 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:23.940115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Searching by: {'deleted': False, 'project_id': '924b0db81eb1479e9bea0f8a60d66526'} {{(pid=121031) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 05:33:23.947283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.947964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.948809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:23.949695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:23.950311 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:23.950947 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.014136 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:24.023073 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-51b09f21-9013-4d46-8421-a231dc3e31a9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.193506 Sep 01 05:33:24.023754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 260/536] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:23 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:24.028647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cae8e69d-c057-4092-85c7-d6e45cf7b258 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '.version_select at 0x7f953b10fc10>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:24.053448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.multi_cell_list [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121031) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 05:33:24.129383 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cae8e69d-c057-4092-85c7-d6e45cf7b258 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905730792" status: 202 len: 0 microversion: 2.1 time: 0.104211 Sep 01 05:33:24.129973 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 261/537] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 1 05:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1905730792 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:33:24.147379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7c364912-1226-488b-b7d2-383f5374376f tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218511 Sep 01 05:33:24.147970 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 277/538] 10.222.0.16 () {58 vars in 1125 bytes} [Thu Sep 1 05:33:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:24.159820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:24.160430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:24.166963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:24.167938 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:24.168369 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.169264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:24.169719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:24.170139 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:24.331985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:24.340079 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7e80a23a-e0eb-4a6c-937f-e40634705be5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1548 microversion: 2.1 time: 0.184352 Sep 01 05:33:24.340647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 262/539] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:24 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1548 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:25.008269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-446c7c87-dcf2-400e-a015-5e6c781bd3c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: .version_select at 0x7f953b1245e0>, body: {"keypair": {"name": "tempest-keypair-575016847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsOHI63SJbuD0Hah6z9lue6N/E+R09G+QI6dUIPgSTqQ+x9UDrIgA+KxJhRuuhAgiy3c/m4wIHBGmFd4aVliIA5xsSTWPdCOM5toff9AbtFi19miVkjiw39WE+yuwZf0A=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:25.021847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-446c7c87-dcf2-400e-a015-5e6c781bd3c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for project 1a200065c13e42babe6353689aabd896. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:33:25.025957 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-446c7c87-dcf2-400e-a015-5e6c781bd3c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for user 11770fbaeacd4fc7bc4052e83630dbb3 and project 1a200065c13e42babe6353689aabd896. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:33:25.045495 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:25.046844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:25.055365 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:25.055850 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:25.056284 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:25.057109 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:25.057566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:25.059290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:25.118663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-446c7c87-dcf2-400e-a015-5e6c781bd3c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119320 Sep 01 05:33:25.119442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 278/540] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:33:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:25.190807 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:25.200158 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d48edb05-ec6f-4bf3-af25-97154d1db99a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.159343 Sep 01 05:33:25.203465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 263/541] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:25 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:26.223167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:26.223789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:26.233602 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.234108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.234576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.235297 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.235749 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.236178 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.283369 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84a32abc-4e28-46e3-b559-73d672ba4fd1"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:26.289634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:26.292251 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.292731 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.293163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.293849 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:26.294366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:26.294798 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:26.382790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:26.391273 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-79f6000a-eade-41f7-8d45-77b248311c5b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.173214 Sep 01 05:33:26.391846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 279/542] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:26 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:27.412581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:27.413199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:27.420685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:27.421155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:27.421584 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:27.422283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:27.422786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:27.423209 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:27.551363 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:27.559464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7620e2e8-b76a-4c16-b983-fad721e03a3a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.150739 Sep 01 05:33:27.559943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 280/543] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:27 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:27.565432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2063352128", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00c5deda-d635-4d45-9035-2f4ba75e32f9"}], "security_groups": [{"name": "tempest-securitygroup--1386470676"}], "key_name": "tempest-keypair-575016847", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:27.666177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] validate_networks() for [('00c5deda-d635-4d45-9035-2f4ba75e32f9', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:33:28.025149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:33:28.025562 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:33:28.026026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:33:28.026480 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:33:28.026885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:33:28.035393 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:28.035861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:28.036285 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.036995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:28.037434 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:28.037846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.053857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for project 1a200065c13e42babe6353689aabd896. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:33:28.058275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for user 11770fbaeacd4fc7bc4052e83630dbb3 and project 1a200065c13e42babe6353689aabd896. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:33:28.069074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:33:28.071645 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:33:28.215943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-38c33d59-81f7-4c86-a0cd-7dfa6f0c1e91 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.653644 Sep 01 05:33:28.216966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 281/544] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:33:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:33:28.227496 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e5a973dc-b664-4908-bd91-611ab6bd03e6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:28.228115 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e5a973dc-b664-4908-bd91-611ab6bd03e6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:28.515556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e5a973dc-b664-4908-bd91-611ab6bd03e6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:28.522261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e5a973dc-b664-4908-bd91-611ab6bd03e6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1241 microversion: 2.1 time: 0.298640 Sep 01 05:33:28.523063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 282/545] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:28 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1241 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:28.580784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:28.581368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:28.587280 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:28.587755 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:28.588187 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.588860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:28.589305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:28.589732 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:28.718210 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:28.726334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6eb1e03c-56a4-4b11-a93a-beb754854392 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.149425 Sep 01 05:33:28.726919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 283/546] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:28 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:28.789339 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e81f06ea-d9da-49f8-9817-be109cb2a389 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "POST /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.509726 Sep 01 05:33:28.789966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 264/547] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:33:26 2022] POST /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments => generated 194 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:29.545492 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:29.546114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:29.553435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:29.553914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:29.554338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:29.555037 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:29.555468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:29.555884 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:29.617022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:29.625177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2dbb7881-7777-4d02-a2f0-f5028bae91c2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1237 microversion: 2.1 time: 0.083664 Sep 01 05:33:29.625732 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 284/548] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:29 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:29.749576 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:29.750297 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:29.752266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:29.757064 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:29.757593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:29.758043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:29.758740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:29.759189 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:29.764059 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:29.896296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:29.904780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-600b81a9-4ddc-43bf-afa7-775e92049cc2 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.160573 Sep 01 05:33:29.905326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 265/549] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:29 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:30.660596 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:30.661201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:30.667599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.668070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.668495 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.669354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.669800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.670215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.743493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:30.752017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-236ba852-9374-4015-b874-352e4747ce90 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1301 microversion: 2.1 time: 0.095557 Sep 01 05:33:30.752595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 285/550] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:30 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:30.931745 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:30.932438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:30.939415 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.939990 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.940481 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:30.941229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:30.941740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:30.942223 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.075759 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:31.083788 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7e583529-a010-4a93-a1de-276a8a203782 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.156809 Sep 01 05:33:31.084354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 266/551] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:30 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:31.774488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:31.775057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:31.781932 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.782420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.782859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.783533 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:31.783976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:31.784388 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:31.917739 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:31.925288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-48b192b2-df46-481c-a413-6b8323659961 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.154755 Sep 01 05:33:31.925847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 286/552] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:31 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:32.104971 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:32.105485 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:32.111875 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.112350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.112780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.113456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.113905 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.114322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.242742 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:32.250845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-aea6d91f-6d08-4bea-a528-02ad08dad0ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.150402 Sep 01 05:33:32.253555 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 267/553] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:32 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:32.955434 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:32.955946 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:32.962315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.962820 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.963247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:32.963920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:32.964360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:32.964777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:33.100596 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:33.108775 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-20809d37-42be-49c4-a7b0-1cd52affbeb1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.157305 Sep 01 05:33:33.109380 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 287/554] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:32 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:33.272012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:33.272679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:33.279679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:33.280156 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:33.280596 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:33.281278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:33.281756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:33.282182 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:33.407235 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:33.415435 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e5a93766-8d79-45cc-a7a1-dfad1d98fd57 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.147313 Sep 01 05:33:33.415998 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 268/555] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:33 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:34.129898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:34.131451 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:34.140338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.141087 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.141704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.142731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.143463 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.143973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.296236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:34.299740 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:34.313008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e670bc62-3527-408f-b150-d8c1635cfeb7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.178522 Sep 01 05:33:34.313008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 288/556] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:34 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:34.317958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-ca1f47dc-a7a5-456e-944e-daef3b85a3bc req-421af46f-581c-4e32-80da-608c24496d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7840364-745b-43e2-988f-ad0069efa14a", "tag": "ca36b374-0cc7-4c8e-9fd9-d64396ae32dd"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:34.333510 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ca1f47dc-a7a5-456e-944e-daef3b85a3bc req-421af46f-581c-4e32-80da-608c24496d10 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.334055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ca1f47dc-a7a5-456e-944e-daef3b85a3bc req-421af46f-581c-4e32-80da-608c24496d10 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.334709 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ca1f47dc-a7a5-456e-944e-daef3b85a3bc req-421af46f-581c-4e32-80da-608c24496d10 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.345644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-ca1f47dc-a7a5-456e-944e-daef3b85a3bc req-421af46f-581c-4e32-80da-608c24496d10 service nova] Creating event network-changed:ca36b374-0cc7-4c8e-9fd9-d64396ae32dd for instance a7840364-745b-43e2-988f-ad0069efa14a on hv-cinder-83602 Sep 01 05:33:34.350423 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-ca1f47dc-a7a5-456e-944e-daef3b85a3bc req-421af46f-581c-4e32-80da-608c24496d10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036401 Sep 01 05:33:34.351026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 269/557] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:34.437739 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:34.438275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:34.444975 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.445487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.445917 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.446623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:34.447069 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:34.447483 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:34.575888 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:34.584793 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c1e28929-3a45-4ef7-b77e-b802256e9784 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.151703 Sep 01 05:33:34.585441 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 289/558] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:34 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:35.326443 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:35.327153 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:35.333690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.334169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.334629 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.335306 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.335751 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.336167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.466844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:35.474448 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e85201de-953c-4dfd-9315-f1668fba037e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.152774 Sep 01 05:33:35.475009 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 270/559] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:35 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:35.606094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:35.606755 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:35.613199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.613670 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.614099 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.614803 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:35.615246 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:35.615657 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:35.742367 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:35.750988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7f1a4358-a5c7-4d85-bb36-d8bd2a3a0275 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.148785 Sep 01 05:33:35.751555 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 290/560] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:35 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:36.494327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:36.494884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.501361 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.501842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.502268 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.502986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.503428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.503990 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.636599 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:36.644591 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-78bf0ba6-bb4d-4b21-838d-961bf874add3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.154145 Sep 01 05:33:36.645152 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 271/561] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:36 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:36.772013 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:36.772664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:36.779233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.779724 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.780149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.780816 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:36.781252 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:36.781663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:36.909646 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:36.917802 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f0e18c47-f1c9-4db7-9727-7b8de7eda460 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.149807 Sep 01 05:33:36.918361 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 291/562] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:36 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:37.664996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:37.665632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:37.672462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.672934 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.673362 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:37.674034 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.674507 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.674922 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:37.805596 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:37.813110 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-aead0819-4ed3-45be-92f6-5f5b897de1b1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.151928 Sep 01 05:33:37.813698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 272/563] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:37 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:37.939818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:37.940345 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:37.947131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.947597 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.948023 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:37.948694 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:37.949130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:37.949542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.045574 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:38.076725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:38.085057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-89e3be82-6e11-4fd9-ae11-df9a0fce1809 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.149100 Sep 01 05:33:38.085711 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 292/564] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:37 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:38.834388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:38.835006 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:38.843130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:38.843608 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:38.844038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.844729 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:38.845176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:38.845674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:38.976452 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:38.984809 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-dc00377a-35e2-4435-9dc3-2f9a680df8aa tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.154312 Sep 01 05:33:38.985377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 273/565] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:38 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:39.107717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:39.108362 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:39.110222 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=12 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:39.115820 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.116362 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.116874 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.117616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:39.118193 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:39.118704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:39.258754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:39.267786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d2eaeaba-a9ac-4ad7-9568-886f9c695a44 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.164071 Sep 01 05:33:39.273095 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 293/566] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:39 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:40.013278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:40.013911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:40.020232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.020730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.021155 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.021828 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.022284 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.022721 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.151080 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.159630 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3d495360-1051-48cd-a2c6-ac1ed783a698 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.150308 Sep 01 05:33:40.160161 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 274/567] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:40 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:40.289413 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:40.290020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:40.297140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.297612 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.298073 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.298784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.299340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.299836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.428132 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.436601 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c56a8cf8-1eac-4329-9c18-634d71c990da tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.151116 Sep 01 05:33:40.437167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 294/568] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:40 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:40.610084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:40.610732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:40.616523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.616986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.617440 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.618106 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:40.618575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:40.618988 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:40.745166 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:40.753849 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-36a74c56-b612-4dce-a1d6-21aef9c5a56a tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1594 microversion: 2.1 time: 0.147984 Sep 01 05:33:40.754891 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 275/569] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:40 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1594 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:41.181595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:41.187530 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:41.188667 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.189143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.189574 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.190245 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.190730 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.191140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.408953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:41.416565 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7ca32991-8fec-4659-884b-38a20c0b3679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.238945 Sep 01 05:33:41.417296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 295/570] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:41 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:41.458226 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:41.458854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:41.465308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.465779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.466210 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.467415 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:41.467871 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:41.468317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:41.612624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:41.620924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fe4c808a-740f-4a23-b3c9-a8de2db647fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1736 microversion: 2.1 time: 0.166513 Sep 01 05:33:41.621491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 276/571] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:41 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:42.437792 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:42.438631 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:42.445577 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.446078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.446523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.447226 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.447661 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.448073 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.641176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:42.642285 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:42.648815 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.649294 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.649724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.650433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.650884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.651504 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.669572 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:42.799943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:42.808086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-847940ee-5de9-4113-9cd3-f7ec6dad0d2e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1716 microversion: 2.1 time: 0.170869 Sep 01 05:33:42.808753 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 277/572] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:42 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1716 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:42.813700 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:42.814384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:42.820384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.820919 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.821345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.822202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.822663 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.823080 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.848698 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:42.858364 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bea3916e-7b2d-49e2-b09e-c36f80ae66a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.424870 Sep 01 05:33:42.863019 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 296/573] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:42 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:42.939549 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:42.940113 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:42.946361 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.946882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.947315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.948010 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:42.948486 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:42.948940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:42.986090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lazy-loading 'services' on Instance uuid e673fbc6-81ca-45da-8e45-a2dde14a5df1 {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:43.035149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] HTTP exception thrown: Cannot 'detach_volume' instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 while it is in vm_state rescued Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Request method failure captured: Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments/3cff3c4c-3af6-41d4-aae9-ba992af79c3f HTTP/1.1 Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM7GY7-05XLd0TeVi-mcVC7JFpzwD-jwqAm6yzcGxeKORICry4_2jTuJQYxckn0sa8vpouuBW1fnYs3rPY-GaQbHyhvEk_-1nIDE-sJJM8vCdO4vhNdmvDpUWoSGqxuHQ21_3-0YRZeb7qQz0vWtun5hHwCroFjtoLhrIJL5KUEFPs Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:33:43.036630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: f4a01fadccd941fc98ecc99dac4e25c4 Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:33:43.038033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Cannot 'detach_volume' instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 while it is in vm_state rescued Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'server_id': '8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8', 'id': '3cff3c4c-3af6-41d4-aae9-ba992af79c3f'} Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:43.043417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 while it is in vm_state rescued Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 while it is in vm_state rescued Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:33:43.046568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Returning 409 to user: Cannot 'detach_volume' instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 while it is in vm_state rescued {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:43.049333 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dee4d926-5a43-4156-b76b-8dec91ad45ae tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments/3cff3c4c-3af6-41d4-aae9-ba992af79c3f" status: 409 len: 152 microversion: 2.1 time: 0.103083 Sep 01 05:33:43.049333 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 297/574] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:33:42 2022] DELETE /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments/3cff3c4c-3af6-41d4-aae9-ba992af79c3f => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 05:33:43.049333 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:43.049333 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:43.056011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.062519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.062519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.062519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.062519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.062902 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.286547 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-083fdd30-baf7-4b7f-b8c6-95e5f10107d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1/os-volume_attachments/166403eb-af30-41d2-a5ba-cc5868e8b64f" status: 202 len: 0 microversion: 2.1 time: 0.476440 Sep 01 05:33:43.289234 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 278/575] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:33:42 2022] DELETE /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1/os-volume_attachments/166403eb-af30-41d2-a5ba-cc5868e8b64f => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:33:43.316588 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4b133055-b9d7-41e0-9c31-c3f42b95e2fa tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "POST /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/action" status: 202 len: 0 microversion: 2.1 time: 0.272647 Sep 01 05:33:43.323963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 298/576] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:33:43 2022] POST /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:33:43.335639 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:43.336345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:43.343001 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.343877 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.344564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.345452 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.346138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.346794 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.484670 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:43.495055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-05e2c300-2a79-4040-aaf4-c0a4cdac021c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1724 microversion: 2.1 time: 0.166968 Sep 01 05:33:43.496376 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 279/577] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:43 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:43.667029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-aaf2f3b4-2f52-4bc7-be4f-0ad8bdeb04fa req-13e8c6d8-083d-4c06-a09d-39af0f9b3565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e5b578-ab03-48a7-9272-9432987ef817", "tag": "bd7c102d-defb-4763-8b8b-49ff53fc8472"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:43.679418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-aaf2f3b4-2f52-4bc7-be4f-0ad8bdeb04fa req-13e8c6d8-083d-4c06-a09d-39af0f9b3565 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.680380 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-aaf2f3b4-2f52-4bc7-be4f-0ad8bdeb04fa req-13e8c6d8-083d-4c06-a09d-39af0f9b3565 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.680812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-aaf2f3b4-2f52-4bc7-be4f-0ad8bdeb04fa req-13e8c6d8-083d-4c06-a09d-39af0f9b3565 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.692539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-aaf2f3b4-2f52-4bc7-be4f-0ad8bdeb04fa req-13e8c6d8-083d-4c06-a09d-39af0f9b3565 service nova] Creating event network-changed:bd7c102d-defb-4763-8b8b-49ff53fc8472 for instance f5e5b578-ab03-48a7-9272-9432987ef817 on hv-cinder-83602 Sep 01 05:33:43.697971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-aaf2f3b4-2f52-4bc7-be4f-0ad8bdeb04fa req-13e8c6d8-083d-4c06-a09d-39af0f9b3565 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035112 Sep 01 05:33:43.698569 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 299/578] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:43.881470 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:43.882038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:43.889063 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.889547 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.889980 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:43.890709 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:43.891159 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:43.891574 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:44.108503 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:44.116753 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ae3679a8-0ffb-4ad1-9d1b-373b1de7b1c7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.239357 Sep 01 05:33:44.118386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 280/579] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:43 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:44.518284 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:44.519015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:44.526771 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:44.527250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:44.527678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:44.528378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:44.528820 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:44.529272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:44.721303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:44.730520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ab0b9aa6-0ab2-425c-803f-14ea06fe01fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1724 microversion: 2.1 time: 0.216688 Sep 01 05:33:44.731761 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 300/580] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:44 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:45.138752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:45.139368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:45.146675 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.147265 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.150725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.150725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.150725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.150725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.288528 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:45.296796 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4c2a285a-8068-4a39-9aca-681297a0c473 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.162018 Sep 01 05:33:45.297545 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 281/581] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:45 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:45.499355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:45.499846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:45.505725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.506197 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.506665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.507341 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.507785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.508199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.536840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:33:45.753439 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:45.754038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:45.761541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.762047 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.762685 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.763411 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.764022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.764441 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.772187 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c0891ca8-518a-4996-9961-9c1b2dadb503 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 204 len: 0 microversion: 2.1 time: 0.276547 Sep 01 05:33:45.773685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 301/582] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:33:45 2022] DELETE /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:33:45.782134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:45.783969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:45.791318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.792296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.792748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.793444 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:45.794300 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:45.795250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:45.908378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:45.916571 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-36ade435-27b4-4695-a3b6-c2a3db411f4c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1724 microversion: 2.1 time: 0.167368 Sep 01 05:33:45.917363 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 282/583] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:45 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:45.947392 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:45.956547 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c5970155-2f78-424f-8352-56deb80e3f8f tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1512 microversion: 2.1 time: 0.179180 Sep 01 05:33:45.959013 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 302/584] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:45 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:46.014393 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-c3a8f513-7a13-4c68-ba39-2b98b50f3628 req-b7e02194-7e8c-433a-964b-e4d1fc67a2da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7840364-745b-43e2-988f-ad0069efa14a", "name": "network-vif-plugged", "status": "completed", "tag": "ca36b374-0cc7-4c8e-9fd9-d64396ae32dd"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:46.032257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c3a8f513-7a13-4c68-ba39-2b98b50f3628 req-b7e02194-7e8c-433a-964b-e4d1fc67a2da service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.033924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c3a8f513-7a13-4c68-ba39-2b98b50f3628 req-b7e02194-7e8c-433a-964b-e4d1fc67a2da service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.033924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c3a8f513-7a13-4c68-ba39-2b98b50f3628 req-b7e02194-7e8c-433a-964b-e4d1fc67a2da service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.044709 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-c3a8f513-7a13-4c68-ba39-2b98b50f3628 req-b7e02194-7e8c-433a-964b-e4d1fc67a2da service nova] Creating event network-vif-plugged:ca36b374-0cc7-4c8e-9fd9-d64396ae32dd for instance a7840364-745b-43e2-988f-ad0069efa14a on hv-cinder-83602 Sep 01 05:33:46.050080 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-c3a8f513-7a13-4c68-ba39-2b98b50f3628 req-b7e02194-7e8c-433a-964b-e4d1fc67a2da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040829 Sep 01 05:33:46.050694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 283/585] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:46.316986 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:46.317603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:46.323877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.324342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.324761 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.325469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.326525 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.326885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.345022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:46.502149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:46.513812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0e59a31a-8878-4fed-9c3e-d679d688c42b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.196693 Sep 01 05:33:46.513812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 303/586] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:46 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:46.704362 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1027333113"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:46.707407 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:46.711619 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.712098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.712524 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.713253 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.713701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.714115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.839420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.network.security_group_api [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Adding security group bfbe1e07-cb9b-4f26-89d7-de5d5f633831 to port bd7c102d-defb-4763-8b8b-49ff53fc8472 Sep 01 05:33:46.938963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:46.939572 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:46.946971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.947481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.947912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:46.948603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:46.949049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:46.949699 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.080653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:47.088942 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1c7d4965-a4b9-490b-9530-d61aabd0c10d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1724 microversion: 2.1 time: 0.154428 Sep 01 05:33:47.089514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 304/587] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:46 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:47.094046 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:47.094809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:47.100590 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.101070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.101569 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.102177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.102656 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.103068 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.236409 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:47.244155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b5408c90-413f-45f9-a2ac-94270e1c2b47 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1512 microversion: 2.1 time: 0.153710 Sep 01 05:33:47.244868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 305/588] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:47 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:47.283388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-025aeda2-428f-4a98-84a4-41a07fd0b0ab tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "POST /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/action" status: 202 len: 0 microversion: 2.1 time: 0.583645 Sep 01 05:33:47.283988 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 284/589] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:33:46 2022] POST /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:33:47.293681 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:47.296011 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-f62695fb-2813-403c-afc0-f509d7c1fb13 req-90ca2cc8-cf80-46d5-ae70-e1f1a21d1397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e5b578-ab03-48a7-9272-9432987ef817", "tag": "bd7c102d-defb-4763-8b8b-49ff53fc8472"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:47.296170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:47.297377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:47.302667 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.303149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.303567 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.304247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.304683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.305090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.314839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f62695fb-2813-403c-afc0-f509d7c1fb13 req-90ca2cc8-cf80-46d5-ae70-e1f1a21d1397 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.315243 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f62695fb-2813-403c-afc0-f509d7c1fb13 req-90ca2cc8-cf80-46d5-ae70-e1f1a21d1397 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.315673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-f62695fb-2813-403c-afc0-f509d7c1fb13 req-90ca2cc8-cf80-46d5-ae70-e1f1a21d1397 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.328876 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-f62695fb-2813-403c-afc0-f509d7c1fb13 req-90ca2cc8-cf80-46d5-ae70-e1f1a21d1397 service nova] Creating event network-changed:bd7c102d-defb-4763-8b8b-49ff53fc8472 for instance f5e5b578-ab03-48a7-9272-9432987ef817 on hv-cinder-83602 Sep 01 05:33:47.335087 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-f62695fb-2813-403c-afc0-f509d7c1fb13 req-90ca2cc8-cf80-46d5-ae70-e1f1a21d1397 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046818 Sep 01 05:33:47.335943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 285/590] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:47.474663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:47.484015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b09e0f33-2379-4849-8a96-43d7b5afd6a9 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1760 microversion: 2.1 time: 0.195171 Sep 01 05:33:47.484584 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 306/591] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:47 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1760 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:47.532822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:47.533648 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:47.540057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.540530 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.540961 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.541654 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:47.542104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:47.542543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:47.678181 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:47.685981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b5b4b3bf-d11b-48cc-aff8-239d2e6651cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.158816 Sep 01 05:33:47.686668 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 286/592] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:47 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:48.110581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:48.111171 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:48.117414 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.117879 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.118321 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.119012 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.119451 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.119908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.250119 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.258220 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a7904418-e856-44f9-aaa7-c7bdfdeaad13 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1724 microversion: 2.1 time: 0.152130 Sep 01 05:33:48.258813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 307/593] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:48 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:48.268499 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:48.269101 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:48.275368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.275839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.276269 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.277035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.277486 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.277907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.404433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.412049 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-10233c15-3f2c-4cbe-86df-d9a0d10b1195 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1512 microversion: 2.1 time: 0.147353 Sep 01 05:33:48.412612 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 287/594] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:48 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:48.705860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:48.706520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:48.712437 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.712935 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.713387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.714230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:48.714703 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:48.715141 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:48.842511 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:48.850034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0c1c9f66-88ac-48de-badc-529d4f914f09 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.148009 Sep 01 05:33:48.853590 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 308/595] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:48 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:48.997484 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:48.997963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.004050 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.004524 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.004956 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.005636 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.006090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.006536 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.035025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-86ad572b-227b-498b-8b9d-91d0c2cccc9d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments/3346b174-c710-4575-86b8-b31b22ead05e" status: 200 len: 194 microversion: 2.20 time: 0.041553 Sep 01 05:33:49.035597 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 288/596] 10.222.0.16 () {60 vars in 1454 bytes} [Thu Sep 1 05:33:48 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments/3346b174-c710-4575-86b8-b31b22ead05e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:33:49.108153 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.108541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.115334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.116982 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.116982 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.117672 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.118360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.119027 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.210338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lazy-loading 'services' on Instance uuid 4659e047-b384-4220-b0d3-26e9f67354c5 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:49.280666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.281365 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.287718 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.288299 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.288733 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.289407 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.289851 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.290305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.404860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6aeabf0e-e483-40ff-b185-7162fea1d489 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments/3346b174-c710-4575-86b8-b31b22ead05e" status: 202 len: 0 microversion: 2.20 time: 0.300562 Sep 01 05:33:49.405707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 309/597] 10.222.0.16 () {60 vars in 1457 bytes} [Thu Sep 1 05:33:49 2022] DELETE /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments/3346b174-c710-4575-86b8-b31b22ead05e => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:33:49.414700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.417339 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.423523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.423995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.424420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.425097 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.425539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.425952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.457903 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0d4b4f50-3f07-49d6-ba41-9f7b396644d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047672 Sep 01 05:33:49.458762 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 310/598] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:33:49.463597 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.464402 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.471160 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.471634 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.472056 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.472738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.473361 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.473771 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.508290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.520076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cf2d9cc7-c214-4afe-87e1-8dc4da09970f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1730 microversion: 2.1 time: 0.243816 Sep 01 05:33:49.536031 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 289/599] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:49.545517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.546312 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.552897 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.556686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.556686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.556686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.556686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.557146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.658055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e7fa97ae-49e7-4e0f-80fa-05788fb05663 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118030 Sep 01 05:33:49.662825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 290/600] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:33:49.772869 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:49.780767 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-e3b5e930-6415-47ee-8a7c-d7bd9b304cd4 req-af69b79b-fc1b-4ee5-bde4-512b6eb80beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e673fbc6-81ca-45da-8e45-a2dde14a5df1", "name": "network-vif-deleted", "tag": "62acfc85-a052-4d6f-9355-f32323f5b35d"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:49.781614 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-78f3465c-a56c-496f-a2c3-3cbdc7d8c0ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1512 microversion: 2.1 time: 0.321493 Sep 01 05:33:49.782759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 311/601] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:49.790854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-e3b5e930-6415-47ee-8a7c-d7bd9b304cd4 req-af69b79b-fc1b-4ee5-bde4-512b6eb80beb service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.791318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-e3b5e930-6415-47ee-8a7c-d7bd9b304cd4 req-af69b79b-fc1b-4ee5-bde4-512b6eb80beb service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.791948 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-e3b5e930-6415-47ee-8a7c-d7bd9b304cd4 req-af69b79b-fc1b-4ee5-bde4-512b6eb80beb service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.804563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-e3b5e930-6415-47ee-8a7c-d7bd9b304cd4 req-af69b79b-fc1b-4ee5-bde4-512b6eb80beb service nova] Creating event network-vif-deleted:62acfc85-a052-4d6f-9355-f32323f5b35d for instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 on hv-cinder-83602 Sep 01 05:33:49.809428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-e3b5e930-6415-47ee-8a7c-d7bd9b304cd4 req-af69b79b-fc1b-4ee5-bde4-512b6eb80beb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032700 Sep 01 05:33:49.810567 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 291/602] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:49.871571 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:49.872282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:49.878696 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.879165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.879586 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:49.880256 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:49.880726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:49.881134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.216087 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:50.223776 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-18465e2f-5bed-4874-800d-f73664d8923a tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.356014 Sep 01 05:33:50.224344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 312/603] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:49 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:50.472115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:50.474447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:50.482878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.483744 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.483880 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.484571 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.485037 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.485450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.520188 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f0c55c4c-3676-4950-aaf7-774e52316510 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052475 Sep 01 05:33:50.521068 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 292/604] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 1 05:33:50 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:33:50.803251 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:50.803857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:50.809912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.810417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.817591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.817591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.817591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.817591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.844265 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:50.844860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:50.845167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:50.845609 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lazy-loading 'fault' on Instance uuid e673fbc6-81ca-45da-8e45-a2dde14a5df1 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:50.900732 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:50.909185 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-67770f10-cfb2-4aaa-96e3-cc61e44e0c9a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1308 microversion: 2.1 time: 0.109797 Sep 01 05:33:50.912757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 313/605] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:50 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:51.111152 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-e873dd04-5706-4233-bac6-9d6be1f34811 req-7acb8e84-ab9c-47d5-accf-04001a2ebc1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8", "tag": "2d4a1424-e280-43c5-9a9b-43fb5a110f2c"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:51.123742 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-e873dd04-5706-4233-bac6-9d6be1f34811 req-7acb8e84-ab9c-47d5-accf-04001a2ebc1e service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.124400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-e873dd04-5706-4233-bac6-9d6be1f34811 req-7acb8e84-ab9c-47d5-accf-04001a2ebc1e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.124978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-e873dd04-5706-4233-bac6-9d6be1f34811 req-7acb8e84-ab9c-47d5-accf-04001a2ebc1e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.139972 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-e873dd04-5706-4233-bac6-9d6be1f34811 req-7acb8e84-ab9c-47d5-accf-04001a2ebc1e service nova] Creating event network-changed:2d4a1424-e280-43c5-9a9b-43fb5a110f2c for instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 on hv-cinder-83602 Sep 01 05:33:51.144902 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-e873dd04-5706-4233-bac6-9d6be1f34811 req-7acb8e84-ab9c-47d5-accf-04001a2ebc1e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037544 Sep 01 05:33:51.145496 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 293/606] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:51.244368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:51.245284 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:51.252627 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.253105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.253532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.254216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.254685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.255101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.482789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:51.504766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a56f82e3-16bb-4884-837c-48e7bcaf3d1f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1367 microversion: 2.1 time: 0.264357 Sep 01 05:33:51.506011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 314/607] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:51 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:51.532825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:51.535337 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:51.542597 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.543450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.544151 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.546626 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.547381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.548071 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.581873 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9c698d64-ad77-4faf-8361-dd56430f2cc5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053410 Sep 01 05:33:51.589016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 294/608] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 1 05:33:51 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:51.660074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:51.660557 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:51.667133 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.668195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.668195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.668824 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.669785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.670198 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.697700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:33:51.932324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:51.933188 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:51.943605 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.944349 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.944998 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.946111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.946777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.947635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.988183 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:51.988712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:51.989180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:51.989627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lazy-loading 'fault' on Instance uuid e673fbc6-81ca-45da-8e45-a2dde14a5df1 {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:33:52.040952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a146bc11-bef5-45c3-af22-4519391c0a08 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 204 len: 0 microversion: 2.20 time: 0.384126 Sep 01 05:33:52.041620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 315/609] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 1 05:33:51 2022] DELETE /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:33:52.047125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.055200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8926ce73-965a-49c8-a743-54aaea837f62 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 200 len: 1308 microversion: 2.1 time: 0.127324 Sep 01 05:33:52.055914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 295/610] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:51 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:33:52.058779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:52.059686 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:52.075643 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.076475 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.077276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.077980 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.078778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.079709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.225330 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.234319 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.235851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.237027 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-054b5287-95d1-4056-a31f-91020c113090 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.189262 Sep 01 05:33:52.237581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 316/611] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:52 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:52.525771 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:52.526364 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:52.532845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.533315 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.533860 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.534393 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.534852 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.535264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.553184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:52.667892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:52.675459 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-89e369f0-08b0-490a-9deb-90861ddb94db tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1557 microversion: 2.1 time: 0.153588 Sep 01 05:33:52.676023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 296/612] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:52 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:33:52.696056 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:52.698771 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:52.703499 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.703966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.704388 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.705105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:52.705544 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:52.705956 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:52.722580 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:52.781511 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6b72aff2-2807-4e73-aeaf-01882d4d2679 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089478 Sep 01 05:33:52.782131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 317/613] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 05:33:52 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:53.076224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:53.076956 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: e673fbc6-81ca-45da-8e45-a2dde14a5df1] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:53.083058 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.083611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.084103 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.084865 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.085372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.085885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.099233 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] HTTP exception thrown: Instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 could not be found. Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Request method failure captured: Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 HTTP/1.1 Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEPu65vnvIAfKvHf9HowDAD-9EwdgHnNQvMReD4h8VGfZOeY4IE6YyhkJW_D_1gQJ0ffSXMagRPVHHPko1Zi69d7IDxjbRlUVAeht9XH-JpMRiyRJNK_nKro98Bj48jDn1Gi6mdI4iWSwttuIJDlenbGiIlEVdjdUnhHFEbXakisQuo Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: be72f5c9d9724a2a87a0a97c0d2d0cd8 Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesSnapshotTestJSON-417643766 Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:33:53.101054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be72f5c9d9724a2a87a0a97c0d2d0cd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be72f5c9d9724a2a87a0a97c0d2d0cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be72f5c9d9724a2a87a0a97c0d2d0cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be72f5c9d9724a2a87a0a97c0d2d0cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesSnapshotTestJSON-417643766 Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: be72f5c9d9724a2a87a0a97c0d2d0cd8 Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-417643766 Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesSnapshotTestJSON-417643766-project Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 9d01f65308f544b79d9c65e57705d9b7 Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesSnapshotTestJSON-417643766-project Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 could not be found. Sep 01 05:33:53.102653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': 'e673fbc6-81ca-45da-8e45-a2dde14a5df1'} Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 could not be found. Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:53.107241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 could not be found. Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 could not be found. Sep 01 05:33:53.108760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:53.109997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Returning 404 to user: Instance e673fbc6-81ca-45da-8e45-a2dde14a5df1 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:53.109997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f10484e1-fc72-462c-a7c6-809dee5f6db9 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1" status: 404 len: 111 microversion: 2.1 time: 0.030195 Sep 01 05:33:53.109997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 297/614] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:33:53 2022] GET /compute/v2.1/servers/e673fbc6-81ca-45da-8e45-a2dde14a5df1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:33:53.162754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-e34bd3d3-705f-4f71-98a1-bdc72e19f0af req-ae9a880f-cfb6-43fa-9b0e-c8f5a8765c2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8", "tag": "2d4a1424-e280-43c5-9a9b-43fb5a110f2c"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:53.173188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e34bd3d3-705f-4f71-98a1-bdc72e19f0af req-ae9a880f-cfb6-43fa-9b0e-c8f5a8765c2e service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.173610 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e34bd3d3-705f-4f71-98a1-bdc72e19f0af req-ae9a880f-cfb6-43fa-9b0e-c8f5a8765c2e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.174025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-e34bd3d3-705f-4f71-98a1-bdc72e19f0af req-ae9a880f-cfb6-43fa-9b0e-c8f5a8765c2e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.185818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-e34bd3d3-705f-4f71-98a1-bdc72e19f0af req-ae9a880f-cfb6-43fa-9b0e-c8f5a8765c2e service nova] Creating event network-changed:2d4a1424-e280-43c5-9a9b-43fb5a110f2c for instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 on hv-cinder-83602 Sep 01 05:33:53.191053 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-e34bd3d3-705f-4f71-98a1-bdc72e19f0af req-ae9a880f-cfb6-43fa-9b0e-c8f5a8765c2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033008 Sep 01 05:33:53.191704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 318/615] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:53.259846 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:53.260440 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:53.266845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.267357 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.267786 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.268460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:53.268897 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:53.269310 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:53.398637 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.407799 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.409245 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:53.410455 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4df39887-bb7c-4640-b11b-657d22be3c58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1723 microversion: 2.20 time: 0.154598 Sep 01 05:33:53.411429 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 298/616] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:53 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:54.437861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:54.438263 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:54.450232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.452071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.452707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.453630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.454251 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.455045 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.527114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.536030 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.537659 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:54.538888 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8899350c-b996-42c5-a365-ba42b8d865d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1655 microversion: 2.20 time: 0.109147 Sep 01 05:33:54.539457 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 319/617] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:54 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:33:54.725416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-11cce89d-800f-4987-9ed4-5f92d52538b3 req-f53ab26b-9174-4448-b018-96987c98cac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4659e047-b384-4220-b0d3-26e9f67354c5", "name": "network-vif-deleted", "tag": "7cbd2023-a83e-445a-b3a8-6aadb6c3c59c"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:54.736423 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-11cce89d-800f-4987-9ed4-5f92d52538b3 req-f53ab26b-9174-4448-b018-96987c98cac2 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:54.736898 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-11cce89d-800f-4987-9ed4-5f92d52538b3 req-f53ab26b-9174-4448-b018-96987c98cac2 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:54.737322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-11cce89d-800f-4987-9ed4-5f92d52538b3 req-f53ab26b-9174-4448-b018-96987c98cac2 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:54.750788 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-11cce89d-800f-4987-9ed4-5f92d52538b3 req-f53ab26b-9174-4448-b018-96987c98cac2 service nova] Creating event network-vif-deleted:7cbd2023-a83e-445a-b3a8-6aadb6c3c59c for instance 4659e047-b384-4220-b0d3-26e9f67354c5 on hv-cinder-83602 Sep 01 05:33:54.756185 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-11cce89d-800f-4987-9ed4-5f92d52538b3 req-f53ab26b-9174-4448-b018-96987c98cac2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035101 Sep 01 05:33:54.758586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 299/618] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:55.205812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-dff3f7e7-f885-40e8-82e8-ac720011b094 req-213ce45f-11ab-4118-81cd-62b652249d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7840364-745b-43e2-988f-ad0069efa14a", "tag": "ca36b374-0cc7-4c8e-9fd9-d64396ae32dd"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:55.215264 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-dff3f7e7-f885-40e8-82e8-ac720011b094 req-213ce45f-11ab-4118-81cd-62b652249d3f service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.215812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-dff3f7e7-f885-40e8-82e8-ac720011b094 req-213ce45f-11ab-4118-81cd-62b652249d3f service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.216830 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-dff3f7e7-f885-40e8-82e8-ac720011b094 req-213ce45f-11ab-4118-81cd-62b652249d3f service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.227569 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-dff3f7e7-f885-40e8-82e8-ac720011b094 req-213ce45f-11ab-4118-81cd-62b652249d3f service nova] Creating event network-changed:ca36b374-0cc7-4c8e-9fd9-d64396ae32dd for instance a7840364-745b-43e2-988f-ad0069efa14a on hv-cinder-83602 Sep 01 05:33:55.233008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-dff3f7e7-f885-40e8-82e8-ac720011b094 req-213ce45f-11ab-4118-81cd-62b652249d3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030961 Sep 01 05:33:55.233784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 320/619] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:33:55.563240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:55.564040 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:55.570915 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.571480 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.571908 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.572596 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:55.573043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:55.573454 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:55.639786 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.648416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.650082 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:55.651291 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c2f4b3a2-25a2-40bb-b3d9-0ea286d05455 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1655 microversion: 2.20 time: 0.092617 Sep 01 05:33:55.651841 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 300/620] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:55 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1655 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:56.676425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:56.677124 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:56.683433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.683902 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.684544 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.685423 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:56.685872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:56.686292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:56.758504 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.768736 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.771747 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:33:56.772923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3c610950-d821-4bb6-84df-639faedf9f7b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 200 len: 1366 microversion: 2.20 time: 0.101443 Sep 01 05:33:56.773504 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 321/621] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:56 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:33:57.796696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:57.797292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:33:57.803632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.804101 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.804526 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.805198 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:33:57.805642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:33:57.806057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:33:57.820402 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] HTTP exception thrown: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Request method failure captured: Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 HTTP/1.1 Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM4f-8x6Wthtkr9dzuo3JL2NQB8NKh1kDHv8FG12uCh_6CJGRchb_w0THcKGieJvaStq13VEWqbeLFhok9gj6Liv3rG62v-NdYD9YdVbxFWOZZuCkxYdgQQ5Sml-0UK-pf_2cZlVbpguJEc-6_lSnsQxqvcu7nqVxlu40ws_ldLbPg Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:33:57.822003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: f661527186794ba296b322c22a78f3f0 Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:33:57.823644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '4659e047-b384-4220-b0d3-26e9f67354c5'} Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:33:57.824450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:33:57.825635 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:33:57.826732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Returning 404 to user: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:33:57.826732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0fba8e22-24a9-4027-a09c-1f1e07a12d8a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 404 len: 111 microversion: 2.20 time: 0.031049 Sep 01 05:33:57.826732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 301/622] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:33:57 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:33:57.832180 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-96f1d482-d4a9-43de-84ab-d668a3074494 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '.version_select at 0x7f953ae72670>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:33:57.908811 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-96f1d482-d4a9-43de-84ab-d668a3074494 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954225171" status: 204 len: 0 microversion: 2.20 time: 0.080313 Sep 01 05:33:57.909394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 322/623] 10.222.0.16 () {60 vars in 1259 bytes} [Thu Sep 1 05:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954225171 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:33:58.666698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a66a1222-116e-481b-88b3-b7ab36518bae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'create', calling method: .version_select at 0x7f953b0189d0>, body: {"keypair": {"name": "tempest-keypair-1589126514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+/CBgZE/ntjlXPtREEOKdP2xmn/OgbfXz9kV1HNBKDeExAX79bLN+hA24RIP9VLlZiMAFoKql3FEpBqT0axPRJ4uUj+V2/0ifJYbYI1iZsVOaXu/il9jTGH6ttlDomOQ=="}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:33:58.681644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-a66a1222-116e-481b-88b3-b7ab36518bae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Getting quotas for project 538589fdc80248a3a3e82802151b4eb6. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:33:58.685878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-a66a1222-116e-481b-88b3-b7ab36518bae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Getting quotas for user f661527186794ba296b322c22a78f3f0 and project 538589fdc80248a3a3e82802151b4eb6. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:33:58.813887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a66a1222-116e-481b-88b3-b7ab36518bae tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.151033 Sep 01 05:33:58.814557 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 302/624] 10.222.0.16 () {62 vars in 1200 bytes} [Thu Sep 1 05:33:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 05:34:01.321166 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1982884525", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4be59972-fc0c-442c-aca3-658b1a92211f"}], "security_groups": [{"name": "tempest-securitygroup--1699681283"}], "key_name": "tempest-keypair-1589126514", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:01.421969 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] validate_networks() for [('4be59972-fc0c-442c-aca3-658b1a92211f', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:34:02.017265 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:34:02.017623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:34:02.018203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:34:02.018654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:34:02.019060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:34:02.027647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.028118 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.028541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.029252 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:02.029695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:02.030110 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:02.046819 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Getting quotas for project 538589fdc80248a3a3e82802151b4eb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:34:02.050709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Getting quotas for user f661527186794ba296b322c22a78f3f0 and project 538589fdc80248a3a3e82802151b4eb6. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:34:02.061920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:34:02.064189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:34:02.218039 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9890465f-1662-4f72-93eb-0994b94de440 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.902023 Sep 01 05:34:02.218722 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 323/625] 10.222.0.16 () {62 vars in 1188 bytes} [Thu Sep 1 05:34:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 05:34:02.230147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1cf04fa2-2f34-414b-adc9-57d218a4af5c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:02.230863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1cf04fa2-2f34-414b-adc9-57d218a4af5c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:02.233425 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:02.286914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1cf04fa2-2f34-414b-adc9-57d218a4af5c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.295887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1cf04fa2-2f34-414b-adc9-57d218a4af5c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.297335 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1cf04fa2-2f34-414b-adc9-57d218a4af5c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:02.298448 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1cf04fa2-2f34-414b-adc9-57d218a4af5c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1282 microversion: 2.20 time: 0.072945 Sep 01 05:34:02.299007 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 303/626] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:02 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:02.646367 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1245289460", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "networks": [{"uuid": "3fbdd801-9257-44ed-990e-fe6262ade395"}]}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:02.701962 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] validate_networks() for [('3fbdd801-9257-44ed-990e-fe6262ade395', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:34:03.052957 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:34:03.053346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:34:03.053809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:34:03.054201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:34:03.054630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:34:03.063170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.063635 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.064059 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.064809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.065244 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.065653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.083273 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Getting quotas for project be72f5c9d9724a2a87a0a97c0d2d0cd8. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:34:03.086930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Getting quotas for user 9d01f65308f544b79d9c65e57705d9b7 and project be72f5c9d9724a2a87a0a97c0d2d0cd8. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:34:03.098140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:34:03.100413 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:34:03.213785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cf0f9a47-872c-4c79-a330-4b286b04986a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573404 Sep 01 05:34:03.214450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 324/627] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:34:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:34:03.224926 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a432ed19-c40a-41f9-905e-b4fc8ec49bef tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:03.225535 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a432ed19-c40a-41f9-905e-b4fc8ec49bef tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:03.285243 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a432ed19-c40a-41f9-905e-b4fc8ec49bef tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.292101 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a432ed19-c40a-41f9-905e-b4fc8ec49bef tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1219 microversion: 2.1 time: 0.070869 Sep 01 05:34:03.292675 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 304/628] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:03 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:03.321421 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:03.322030 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:03.328988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.329276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.329712 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.330401 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:03.330899 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:03.331312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:03.401817 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.409908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.411377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:03.412474 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3aea7d35-6958-4ee8-abf5-234e19e259c3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1286 microversion: 2.20 time: 0.095301 Sep 01 05:34:03.413033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 325/629] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:03 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:04.312467 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:04.313072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:04.320297 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.320775 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.321205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.321880 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.322384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.322871 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.383877 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.392041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-93a1d2a8-f110-4476-b6c9-5d184b9151ff tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1223 microversion: 2.1 time: 0.083492 Sep 01 05:34:04.392606 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 305/630] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:04 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:04.434420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:04.435028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:04.441590 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.442318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.442782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.443493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:04.443954 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:04.444375 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:04.507785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.518053 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.519785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:04.520894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-987ab613-8c4c-433e-8be9-984c255d08b6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1342 microversion: 2.20 time: 0.090465 Sep 01 05:34:04.521445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 326/631] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:04 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:05.412807 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:05.413396 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:05.420817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.421582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.422035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.422744 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.423194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.423617 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.494950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.503002 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-51d1006c-0db6-488a-8655-ede504410e33 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1271 microversion: 2.1 time: 0.094108 Sep 01 05:34:05.503610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 306/632] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:05 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:05.545718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:05.546371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:05.553150 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.553634 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.554065 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.554781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:05.555233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:05.555652 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:05.697102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.706062 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.707948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:05.709111 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-56f63ead-f637-469b-93d9-e0d903cf225d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1408 microversion: 2.20 time: 0.168799 Sep 01 05:34:05.709616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 327/633] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:05 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:06.275713 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-384397ed-14e5-445b-80fc-42e2585ce9b3 req-3a269753-d0d1-48a4-88c5-a1787fd7a125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e750cb-b7bf-46f8-945d-51866ebb4c2e", "tag": "cecbb19c-0368-43b2-a813-da4b7b5869a1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:06.286555 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-384397ed-14e5-445b-80fc-42e2585ce9b3 req-3a269753-d0d1-48a4-88c5-a1787fd7a125 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.287032 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-384397ed-14e5-445b-80fc-42e2585ce9b3 req-3a269753-d0d1-48a4-88c5-a1787fd7a125 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.287463 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-384397ed-14e5-445b-80fc-42e2585ce9b3 req-3a269753-d0d1-48a4-88c5-a1787fd7a125 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.299441 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-384397ed-14e5-445b-80fc-42e2585ce9b3 req-3a269753-d0d1-48a4-88c5-a1787fd7a125 service nova] Creating event network-changed:cecbb19c-0368-43b2-a813-da4b7b5869a1 for instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e on hv-cinder-83602 Sep 01 05:34:06.304502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-384397ed-14e5-445b-80fc-42e2585ce9b3 req-3a269753-d0d1-48a4-88c5-a1787fd7a125 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032641 Sep 01 05:34:06.305320 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 307/634] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:06.531961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:06.532589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:06.542983 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.550573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.550573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.550573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.550573 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.551438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.702496 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.710562 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f49d2782-bdf5-4f0b-a1b8-69391e202c2e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.186893 Sep 01 05:34:06.711368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 328/635] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:06 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:06.736677 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:06.737428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:06.744317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.745052 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.745678 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.746399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:06.747750 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:06.748184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:06.977911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.987270 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.988982 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:06.990447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e87a4706-8923-4108-a20a-5870daa1f9e6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1408 microversion: 2.20 time: 0.261567 Sep 01 05:34:06.991046 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 308/636] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:06 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:07.421107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-2e4cda77-477b-45e9-8c8a-255277f3f376 req-140be7ff-2f2a-4fa4-a40d-b517a682ad9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "213150a5-0351-4bb9-9ff3-b177abc6aede", "tag": "c9e1e5cf-8846-4eee-92f4-1074abb9dc36"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:07.434505 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2e4cda77-477b-45e9-8c8a-255277f3f376 req-140be7ff-2f2a-4fa4-a40d-b517a682ad9f service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.434982 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2e4cda77-477b-45e9-8c8a-255277f3f376 req-140be7ff-2f2a-4fa4-a40d-b517a682ad9f service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.435923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-2e4cda77-477b-45e9-8c8a-255277f3f376 req-140be7ff-2f2a-4fa4-a40d-b517a682ad9f service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.446658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-2e4cda77-477b-45e9-8c8a-255277f3f376 req-140be7ff-2f2a-4fa4-a40d-b517a682ad9f service nova] Creating event network-changed:c9e1e5cf-8846-4eee-92f4-1074abb9dc36 for instance 213150a5-0351-4bb9-9ff3-b177abc6aede on hv-cinder-83602 Sep 01 05:34:07.452937 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-2e4cda77-477b-45e9-8c8a-255277f3f376 req-140be7ff-2f2a-4fa4-a40d-b517a682ad9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034762 Sep 01 05:34:07.452937 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 329/637] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:07.731938 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:07.732712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:07.739285 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.739833 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.740228 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.740899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:07.741349 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:07.741764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:07.867951 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:07.876142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6190e1a5-77c2-471c-af4d-8b1ddddc4e64 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.148083 Sep 01 05:34:07.876725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 309/638] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:07 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:08.014593 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:08.015221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:08.021255 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.021727 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.022159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:08.022876 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.023324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.023743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:08.153181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:08.161457 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:08.163043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:08.164126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-10c3528e-0d2d-4430-85ab-f66d4905f4d4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1408 microversion: 2.20 time: 0.155007 Sep 01 05:34:08.164733 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 330/639] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:08 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:08.897512 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:08.898147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:08.904807 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.905284 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.905706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:08.906381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:08.906846 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:08.907259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:09.042725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:09.050650 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ea7631f7-f658-4faf-8b6c-ea84c3952092 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.157452 Sep 01 05:34:09.051212 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 310/640] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:08 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:09.187192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:09.187703 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:09.194268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:09.194791 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:09.195218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:09.195896 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:09.196338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:09.196753 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:09.324672 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:09.332999 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:09.334529 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:09.335661 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-528bd655-54df-4911-bfa1-1ee6274a9b1b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1408 microversion: 2.20 time: 0.152472 Sep 01 05:34:09.336235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 331/641] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:09 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:10.071780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:10.075427 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:10.078863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:10.079334 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:10.079757 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:10.080428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:10.080868 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:10.081337 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:10.210235 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:10.218447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-31e491d7-d8de-4292-ab2b-79fc145f0ece tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.150495 Sep 01 05:34:10.219006 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 311/642] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:10 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:10.358592 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:10.359195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:10.365309 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:10.365783 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:10.366210 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:10.367066 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:10.367508 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:10.367921 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:10.495101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:10.503212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:10.504652 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:10.505735 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0854ca5b-f7f6-45c3-b702-f21cd298784d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1408 microversion: 2.20 time: 0.151282 Sep 01 05:34:10.506279 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 332/643] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:10 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:11.239466 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:11.240044 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:11.246570 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:11.247040 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:11.247462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:11.248128 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:11.249209 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:11.249622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:11.379085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:11.386509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e4e53744-7897-4023-aefa-649e6b3e8bee tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.150871 Sep 01 05:34:11.387073 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 312/644] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:11 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:11.528579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:11.529281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:11.536045 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:11.536514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:11.539756 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:11.539756 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:11.539756 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:11.539756 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:11.669406 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:11.678215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:11.679681 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:11.680767 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f86f9933-5cbf-4eb9-a115-8f69681743f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1408 microversion: 2.20 time: 0.156527 Sep 01 05:34:11.681318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 333/645] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:11 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:12.107125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-8413dc07-29d5-4487-80a2-8c6eac9736bf req-86e557f0-95b0-449e-a27b-a3b39b930623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e750cb-b7bf-46f8-945d-51866ebb4c2e", "name": "network-vif-plugged", "status": "completed", "tag": "cecbb19c-0368-43b2-a813-da4b7b5869a1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:12.117002 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8413dc07-29d5-4487-80a2-8c6eac9736bf req-86e557f0-95b0-449e-a27b-a3b39b930623 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.117558 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8413dc07-29d5-4487-80a2-8c6eac9736bf req-86e557f0-95b0-449e-a27b-a3b39b930623 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.117991 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8413dc07-29d5-4487-80a2-8c6eac9736bf req-86e557f0-95b0-449e-a27b-a3b39b930623 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.128652 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-8413dc07-29d5-4487-80a2-8c6eac9736bf req-86e557f0-95b0-449e-a27b-a3b39b930623 service nova] Creating event network-vif-plugged:cecbb19c-0368-43b2-a813-da4b7b5869a1 for instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e on hv-cinder-83602 Sep 01 05:34:12.133460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-8413dc07-29d5-4487-80a2-8c6eac9736bf req-86e557f0-95b0-449e-a27b-a3b39b930623 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 Sep 01 05:34:12.134036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 313/646] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:12.407482 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:12.408072 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:12.414250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.414751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.415183 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.415859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.416302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.416718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.590795 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:12.599092 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0d5f2bb3-a81e-4932-9562-c98be849cf31 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.196086 Sep 01 05:34:12.599647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 334/647] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:12 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:12.704781 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:12.705473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:12.711612 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.712086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.712511 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.713184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:12.713628 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:12.714043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:12.842888 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:12.850167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:12.851600 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:12.852743 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4dface76-bb65-4729-bf8d-288aeea774ac tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1408 microversion: 2.20 time: 0.153316 Sep 01 05:34:12.853305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 314/648] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:12 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:13.626800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:13.627411 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:13.629356 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:13.630008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=12 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:13.636540 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.644418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.644418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.644418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.644418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.644802 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.780254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:13.787962 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-369575c6-02fe-4c46-b36e-81097a4918ea tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.165420 Sep 01 05:34:13.788913 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 335/649] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:13 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:13.875122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:13.875769 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:13.877778 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=8 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:13.882891 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.883475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.883896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:13.884565 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:13.885005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:13.885418 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:14.015817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:14.023994 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:14.025701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:14.026836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-333636d6-9f0b-493d-b323-2b3a0c79bf10 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1408 microversion: 2.20 time: 0.155611 Sep 01 05:34:14.027394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 315/650] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:13 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:34:14.265606 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-eec8b9b6-3f2a-4d6a-96a0-17faee5cf98f req-7a8505f3-d273-46ba-a968-251b3a405e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213150a5-0351-4bb9-9ff3-b177abc6aede", "name": "network-vif-plugged", "status": "completed", "tag": "c9e1e5cf-8846-4eee-92f4-1074abb9dc36"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:14.270543 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:14.275616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-eec8b9b6-3f2a-4d6a-96a0-17faee5cf98f req-7a8505f3-d273-46ba-a968-251b3a405e36 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:14.276080 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-eec8b9b6-3f2a-4d6a-96a0-17faee5cf98f req-7a8505f3-d273-46ba-a968-251b3a405e36 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:14.276575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-eec8b9b6-3f2a-4d6a-96a0-17faee5cf98f req-7a8505f3-d273-46ba-a968-251b3a405e36 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:14.288182 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-eec8b9b6-3f2a-4d6a-96a0-17faee5cf98f req-7a8505f3-d273-46ba-a968-251b3a405e36 service nova] Creating event network-vif-plugged:c9e1e5cf-8846-4eee-92f4-1074abb9dc36 for instance 213150a5-0351-4bb9-9ff3-b177abc6aede on hv-cinder-83602 Sep 01 05:34:14.293029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-eec8b9b6-3f2a-4d6a-96a0-17faee5cf98f req-7a8505f3-d273-46ba-a968-251b3a405e36 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Sep 01 05:34:14.293630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 336/651] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:14.827647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:14.828245 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:14.834066 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:14.834606 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:14.835037 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:14.835706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:14.836148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:14.836564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:15.051726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:15.052409 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:15.058964 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:15.059432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:15.059851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:15.060536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:15.061545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:15.061960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:15.075666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:15.083289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3719919b-44df-4626-96d7-30f7aeaace80 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.259432 Sep 01 05:34:15.083857 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 316/652] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:14 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:15.240536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:15.248646 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:15.250060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:15.251212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ccaee2b8-6375-41cc-aad0-eaaccc8eb1ea tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1599 microversion: 2.20 time: 0.204177 Sep 01 05:34:15.251762 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 337/653] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:34:15 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1599 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:34:15.272485 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:15.273020 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:15.278811 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:15.279290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:15.280248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:15.280940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:15.281355 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:15.281765 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:15.359201 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f27158f3-1e99-4765-bedc-497296ae0de7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090516 Sep 01 05:34:15.360375 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 317/654] 10.222.0.16 () {60 vars in 1316 bytes} [Thu Sep 1 05:34:15 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:34:16.104581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:16.105226 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:16.112227 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.112806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.113809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.114090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.114973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.114973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.246961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:16.251507 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-255eb7ac-ed13-454c-a985-b13b4f878019 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1319 microversion: 2.1 time: 0.150609 Sep 01 05:34:16.253113 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 338/655] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:16 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:16.577940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-ad1fe96e-3718-4eaa-b5c8-d38f9e6c7dd4 req-f979cacd-c92a-4a8e-9556-85143981d743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e750cb-b7bf-46f8-945d-51866ebb4c2e", "tag": "cecbb19c-0368-43b2-a813-da4b7b5869a1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:16.587613 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ad1fe96e-3718-4eaa-b5c8-d38f9e6c7dd4 req-f979cacd-c92a-4a8e-9556-85143981d743 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.588214 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ad1fe96e-3718-4eaa-b5c8-d38f9e6c7dd4 req-f979cacd-c92a-4a8e-9556-85143981d743 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.589855 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-ad1fe96e-3718-4eaa-b5c8-d38f9e6c7dd4 req-f979cacd-c92a-4a8e-9556-85143981d743 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.600840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-ad1fe96e-3718-4eaa-b5c8-d38f9e6c7dd4 req-f979cacd-c92a-4a8e-9556-85143981d743 service nova] Creating event network-changed:cecbb19c-0368-43b2-a813-da4b7b5869a1 for instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e on hv-cinder-83602 Sep 01 05:34:16.605866 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-ad1fe96e-3718-4eaa-b5c8-d38f9e6c7dd4 req-f979cacd-c92a-4a8e-9556-85143981d743 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 Sep 01 05:34:16.606562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 318/656] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:16.638440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:16.639625 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:16.647622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.648118 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.648565 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.649324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.649786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.650191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.679583 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:16.890692 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4ab905c5-36c4-459a-bb99-308a111b49e5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "POST /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/action" status: 202 len: 0 microversion: 2.1 time: 0.257871 Sep 01 05:34:16.894695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 339/657] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:34:16 2022] POST /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:34:16.902254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:16.903404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:16.910680 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.911453 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.912272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:16.913016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:16.913480 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:16.914100 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.123242 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:17.138432 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ddec3848-9bdb-4941-a689-79455058a260 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1752 microversion: 2.1 time: 0.240868 Sep 01 05:34:17.139031 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 319/658] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:16 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1752 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:17.274392 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:17.276121 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:17.283850 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:17.284600 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:17.285082 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.285780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:17.286220 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:17.286852 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.442337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:17.455067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-05b7bb4d-3735-4c40-be3a-ad3da96cf202 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1508 microversion: 2.1 time: 0.185126 Sep 01 05:34:17.455856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 340/659] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:17 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:17.476096 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18a169ec-3b99-4052-b811-9a4d6d46640f", "device": "/dev/sdb"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:17.478465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:17.485095 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:17.485576 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:17.486014 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.486732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:17.487181 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:17.487603 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:17.504584 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:18.160201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:18.160808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:18.166777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:18.167249 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:18.167677 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:18.168351 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:18.168833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:18.169205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:18.241406 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7f086b16-8973-4dc5-a7af-bc3cd202cdc8 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "POST /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.769328 Sep 01 05:34:18.242271 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 320/660] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:34:17 2022] POST /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede/os-volume_attachments => generated 194 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:18.313482 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:18.322329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-578c7aff-51e2-4aaa-8a24-03a1c8df8492 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.166016 Sep 01 05:34:18.322934 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 341/661] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:18 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:19.345208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:19.345920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:19.352284 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:19.352754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:19.353184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:19.353857 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:19.354296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:19.354735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:19.500783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:19.508911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cc84fea7-60d3-4c0b-baff-73f298d6cd9d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.167933 Sep 01 05:34:19.509510 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 321/662] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:19 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:20.529541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:20.530148 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:20.536690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:20.537168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:20.537598 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:20.538272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:20.538742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:20.539164 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:20.678860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:20.687457 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1081288e-fa2e-45eb-8187-2d93101241f4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.161286 Sep 01 05:34:20.688049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 342/663] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:20 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:21.709047 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:21.709576 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:21.715946 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:21.716415 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:21.716840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:21.717511 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:21.717954 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:21.719150 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:21.857936 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:21.866018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5d7c7327-c9f1-49d9-a250-85c1f7e8ada7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.160920 Sep 01 05:34:21.866603 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 322/664] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:21 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:22.886900 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:22.887540 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:22.894035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:22.894549 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:22.894984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:22.895663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:22.896130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:22.896539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:23.041664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:23.049930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-37cf45d8-e7f9-4e50-9789-ffd8815f0326 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.166864 Sep 01 05:34:23.050525 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 343/665] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:22 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:24.071038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:24.071630 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:24.078038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:24.078537 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:24.078960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:24.079630 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:24.080068 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:24.080477 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:24.226575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:24.235304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-336f9cf2-a1d2-4fb6-9933-a97deeb41a60 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.168089 Sep 01 05:34:24.235863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 323/666] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:24 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:25.256295 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:25.256844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:25.263409 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:25.263874 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:25.264294 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:25.265487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:25.265930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:25.266339 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:25.409657 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:25.417971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-49196d4e-42b8-435d-ad6f-2b585c2bf047 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.165671 Sep 01 05:34:25.418572 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 344/667] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:25 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:26.440045 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:26.440645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:26.447257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:26.447727 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:26.448150 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:26.448817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:26.449254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:26.449663 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:26.590187 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:26.598513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-bca7ba43-b87a-41cd-981a-56f7b308cd61 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.162873 Sep 01 05:34:26.599087 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 324/668] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:26 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:27.620545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:27.621152 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:27.627595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:27.628074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:27.628500 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:27.629174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:27.629619 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:27.630034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:27.772307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:27.781188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-db699c15-af33-49ad-b12b-eef95b190727 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.163848 Sep 01 05:34:27.781754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 345/669] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:27 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:28.802078 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:28.802726 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:28.809622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:28.810094 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:28.810551 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:28.811236 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:28.812248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:28.812672 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:28.951410 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:28.959679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cb1c9233-e181-4922-afa9-4c55c477565d tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.161570 Sep 01 05:34:28.960235 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 325/670] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:28 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:29.980620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:29.981229 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:29.988191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:29.988661 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:29.989089 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:29.989766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:29.990225 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:29.990662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:30.131393 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:30.139541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-549e11cd-6e07-48c2-b18e-6dfbd2cfd420 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.162792 Sep 01 05:34:30.140713 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 346/671] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:29 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:31.160749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:31.161351 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:31.167704 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:31.168274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:31.168696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:31.169363 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:31.169804 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:31.170217 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:31.313481 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:31.321826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-dc512a26-85f3-4ce2-a5c1-b5b738f0bb89 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.164919 Sep 01 05:34:31.322394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 326/672] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:31 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:32.060697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:32.061189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:32.068491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.068963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.069394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.070108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.070587 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.071012 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.155572 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'services' on Instance uuid 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:34:32.344266 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:32.344867 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:32.347318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=52 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:32.354002 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.354631 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.357012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.357012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.357012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.357012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.444598 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-93d3d783-96d3-4747-9bdb-cb28f81fd664 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments/3cff3c4c-3af6-41d4-aae9-ba992af79c3f" status: 202 len: 0 microversion: 2.1 time: 0.387583 Sep 01 05:34:32.445325 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 347/673] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:34:32 2022] DELETE /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments/3cff3c4c-3af6-41d4-aae9-ba992af79c3f => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:34:32.454762 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:32.457219 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:32.463598 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.466057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.466057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.466057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:32.466057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:32.466463 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:32.496647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-74d8107a-098e-46d6-b66b-ac3293fea87b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046845 Sep 01 05:34:32.497219 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 348/674] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:32 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:34:32.500895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:32.509295 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4d2a5c40-345e-4c89-a5cc-07dac1380def tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.169475 Sep 01 05:34:32.511986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 327/675] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:32 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:33.509090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:33.511303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:33.517615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:33.518084 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:33.518550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:33.519248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:33.519688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:33.520102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:33.531576 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:33.532176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:33.538396 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:33.538897 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:33.539324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:33.539996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:33.540436 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:33.540848 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:33.549921 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d1f7e42a-d388-47ee-adaf-425722b9d876 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044711 Sep 01 05:34:33.550493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 349/676] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:33 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:33.685636 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:33.694783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6ab7583d-bd04-4628-b2be-c9bb92c37b38 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.167273 Sep 01 05:34:33.695336 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 328/677] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:33 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:34.561315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:34.563938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:34.570438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.570923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.571391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.572066 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.572506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.572917 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.606436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cb39a93c-60df-494a-a185-c0354273ad6b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049090 Sep 01 05:34:34.606975 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 350/678] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:34 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:34.719616 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:34.719616 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:34.724089 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.724572 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.725019 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.725772 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:34.726224 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:34.726667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:34.876621 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:34.884830 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2212ea54-3efa-474f-9dab-d5a491ef6915 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.173064 Sep 01 05:34:34.885386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 329/679] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:34 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:35.620067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:35.622615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:35.631467 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.631944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.632371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.633063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.633501 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.633912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.666483 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-943c1cba-87e5-422f-8260-eea98ce32c0b tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051829 Sep 01 05:34:35.667047 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 351/680] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:35 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:34:35.742606 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:35.743098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:35.749606 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.750125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.750554 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.751237 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.751688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.752157 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.777323 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:34:35.906489 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:35.907748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:35.913536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.914006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.914494 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:35.917091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:35.917091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:35.917091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.044987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4aabe9dd-9c56-4f9d-853c-a48e528ea12a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 204 len: 0 microversion: 2.1 time: 0.306083 Sep 01 05:34:36.045582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 330/681] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:34:35 2022] DELETE /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:34:36.060985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:36.061874 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:36.068632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.069108 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.069534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.070210 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:36.070677 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:36.071227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:36.074786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:36.083754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4a1911a8-ab0f-4a1e-a2f6-e07c36a82f3c tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.181277 Sep 01 05:34:36.084325 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 352/682] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:35 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:36.206920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:36.214525 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a988a517-79c2-4565-a59b-7c3a950db36e tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1690 microversion: 2.1 time: 0.157730 Sep 01 05:34:36.215092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 331/683] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:36 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:37.105006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:37.105612 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:37.112313 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.112786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.113215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.113885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.114329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.114838 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.235570 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:37.236159 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:37.242513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.243182 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.243610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.244289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.244737 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.245146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.255473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:37.263869 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-42738910-c5d5-41c2-a95f-61da97a2d5ad tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.162709 Sep 01 05:34:37.264445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 353/684] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:37 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:37.374758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:37.382545 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-dfbaa0d3-894c-4b1a-9c0d-7480cdd5b582 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1690 microversion: 2.1 time: 0.150795 Sep 01 05:34:37.383118 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 332/685] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:37 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:37.815471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:37.815954 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:37.821855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.822322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.822775 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.823449 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:37.823888 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:37.824301 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:37.840752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:37.847801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0bf14b0d-9d85-460c-8b23-c8673329b471 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/ips" status: 200 len: 150 microversion: 2.1 time: 0.090335 Sep 01 05:34:37.848344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 354/686] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:34:37 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:38.222233 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:38.222764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:38.228576 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.229049 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.229471 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.230148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.230624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.236488 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.285594 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:38.286272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:38.293616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.294158 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.294619 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.295308 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.295757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.296177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.316437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lazy-loading 'services' on Instance uuid 213150a5-0351-4bb9-9ff3-b177abc6aede {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:34:38.319948 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:38.451107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:38.459556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1cbd5791-d8a4-408a-a7dd-740422c3f893 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.178239 Sep 01 05:34:38.460123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 355/687] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:38 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:38.464818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:38.465607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:38.471250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.471719 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.472143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.472814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:38.473260 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:38.474083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:38.604890 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-45df7204-1d41-4467-9212-8f78aa63b60e tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "DELETE /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede/os-volume_attachments/18a169ec-3b99-4052-b811-9a4d6d46640f" status: 202 len: 0 microversion: 2.1 time: 0.387025 Sep 01 05:34:38.605536 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 333/688] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:34:38 2022] DELETE /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede/os-volume_attachments/18a169ec-3b99-4052-b811-9a4d6d46640f => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:34:38.606399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:38.615554 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5355277b-02a4-4eda-a7e1-20fe8ca2e665 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1690 microversion: 2.1 time: 0.154236 Sep 01 05:34:38.616126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 356/689] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:38 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:39.467324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "502b1548-0868-4655-a1c7-ad4e9c49533f"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:39.470430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:39.477368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.477838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.478268 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.478972 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.479472 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.479890 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.480180 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:39.480923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:39.487300 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.487772 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.488198 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.488878 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.489321 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.489738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.631655 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:39.640460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a9157c65-b820-4990-85a2-ace424ad1d96 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.163673 Sep 01 05:34:39.641265 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 357/690] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:39 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:39.645867 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:39.646576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:39.652129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.652603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.653034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.653712 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:39.654159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:39.654605 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:39.785806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:39.793473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4284cd57-c73e-49a6-8a3e-ae1c9280268c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1690 microversion: 2.1 time: 0.151087 Sep 01 05:34:39.794051 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 358/691] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:39 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:40.661171 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:40.661829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:40.668302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.668776 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.669206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.669884 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.670334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.670783 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.816233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:40.824453 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8be4eb25-8a41-4f9c-90ce-4071ffc715b2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1757 microversion: 2.1 time: 0.167195 Sep 01 05:34:40.825010 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 359/692] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:40 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:40.830508 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:40.831350 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:40.837642 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.837899 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.838279 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.839002 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:40.839441 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:40.839857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:40.949719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cd39e8ea-a4e2-4fde-b1ef-cc9defb2b1df tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.486443 Sep 01 05:34:40.951937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 334/693] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:34:39 2022] POST /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments => generated 194 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:40.986086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:40.996416 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f07e221e-98ed-4ff4-a8e9-193f0485b013 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1690 microversion: 2.1 time: 0.170428 Sep 01 05:34:40.997355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 360/694] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:40 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:41.713088 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-722fe936-9a12-45ff-926c-77f2d4da94c4 req-a6e82509-431d-43ce-afd4-123c13c6a1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8", "name": "network-vif-deleted", "tag": "2d4a1424-e280-43c5-9a9b-43fb5a110f2c"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:41.723513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-722fe936-9a12-45ff-926c-77f2d4da94c4 req-a6e82509-431d-43ce-afd4-123c13c6a1d7 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.724244 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-722fe936-9a12-45ff-926c-77f2d4da94c4 req-a6e82509-431d-43ce-afd4-123c13c6a1d7 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.724666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-722fe936-9a12-45ff-926c-77f2d4da94c4 req-a6e82509-431d-43ce-afd4-123c13c6a1d7 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.737162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-722fe936-9a12-45ff-926c-77f2d4da94c4 req-a6e82509-431d-43ce-afd4-123c13c6a1d7 service nova] Creating event network-vif-deleted:2d4a1424-e280-43c5-9a9b-43fb5a110f2c for instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 on hv-cinder-83602 Sep 01 05:34:41.742163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-722fe936-9a12-45ff-926c-77f2d4da94c4 req-a6e82509-431d-43ce-afd4-123c13c6a1d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033411 Sep 01 05:34:41.742977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 335/695] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:41.849032 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:41.849622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:41.856815 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.861108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.861108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:41.861108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:41.861108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:41.868320 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.019992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:42.020842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:42.029410 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.030193 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.030975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.035279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.035279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.035279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.071686 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:42.086523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-68a33717-b170-4020-b215-498b6256ac34 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1760 microversion: 2.1 time: 0.240810 Sep 01 05:34:42.102862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 361/696] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:41 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1760 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:42.103327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.103327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.103327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.103327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'fault' on Instance uuid 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:34:42.149922 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:42.158787 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2455e320-6dd5-449f-9050-65c7f572e624 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 200 len: 1336 microversion: 2.1 time: 0.143437 Sep 01 05:34:42.159366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 336/697] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:42 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 1336 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:42.915828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:42.916506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:42.923637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.924212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.931065 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.931791 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:42.932249 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:42.932674 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:42.959176 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:34:43.179558 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:43.180163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:43.186687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.187163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.187590 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.188263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.188707 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.189123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.193055 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-221f3966-5612-4f3e-9705-55a1a1ff56bf tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "DELETE /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 204 len: 0 microversion: 2.1 time: 0.280918 Sep 01 05:34:43.193929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 362/698] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:34:42 2022] DELETE /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:34:43.202224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:43.203518 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:43.206163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] HTTP exception thrown: Instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 could not be found. Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Request method failure captured: Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 HTTP/1.1 Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM7GY7-05XLd0TeVi-mcVC7JFpzwD-jwqAm6yzcGxeKORICry4_2jTuJQYxckn0sa8vpouuBW1fnYs3rPY-GaQbHyhvEk_-1nIDE-sJJM8vCdO4vhNdmvDpUWoSGqxuHQ21_3-0YRZeb7qQz0vWtun5hHwCroFjtoLhrIJL5KUEFPs Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:34:43.207817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: f4a01fadccd941fc98ecc99dac4e25c4 Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 could not be found. Sep 01 05:34:43.209416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8'} Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 could not be found. Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:34:43.210292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 could not be found. Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 could not be found. Sep 01 05:34:43.211845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:43.213405 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Returning 404 to user: Instance 8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:34:43.213405 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-afa54432-c117-4cd3-82f4-e4c9fdd04e1c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8" status: 404 len: 111 microversion: 2.1 time: 0.033573 Sep 01 05:34:43.213623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.213734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 337/699] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:43 2022] GET /compute/v2.1/servers/8a1a1606-e0f3-4f85-a6ef-42f6ff4985e8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:34:43.213839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.213839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.213839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:43.213839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:43.214210 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:43.219353 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2ce24d53-09ac-435e-9c43-bcaadacaaa00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '.version_select at 0x7f953afb44c0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:43.294074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2ce24d53-09ac-435e-9c43-bcaadacaaa00 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888678335" status: 202 len: 0 microversion: 2.1 time: 0.079893 Sep 01 05:34:43.294698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 338/700] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 1 05:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1888678335 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:34:43.342711 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:43.351309 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8f476c2c-1fd0-400a-b272-5b51ad63b5c0 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1514 microversion: 2.1 time: 0.153127 Sep 01 05:34:43.351888 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 363/701] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:43 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:44.372721 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:44.373327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:44.380510 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.380981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.381403 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.382112 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:44.382581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:44.382996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:44.508410 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:44.516612 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b215dff9-8e45-48a8-9b9a-f90a08db6a6d tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1514 microversion: 2.1 time: 0.148244 Sep 01 05:34:44.517173 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 339/702] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:44 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:45.538497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:45.539008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:45.541316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:45.546370 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.546879 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.547306 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.547976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.548417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.548826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.641554 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:45.653372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7e84d215-91ff-434d-a4b3-5c8f9872a5d2 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1472 microversion: 2.1 time: 0.115473 Sep 01 05:34:45.653372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 364/703] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:45 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1472 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:45.655200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-898437d2-c538-443c-a1a1-cdb5c308363f req-38ee84fb-7b08-491e-a299-f0b6a4a4443a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213150a5-0351-4bb9-9ff3-b177abc6aede", "name": "network-vif-deleted", "tag": "c9e1e5cf-8846-4eee-92f4-1074abb9dc36"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:45.665311 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-898437d2-c538-443c-a1a1-cdb5c308363f req-38ee84fb-7b08-491e-a299-f0b6a4a4443a service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:45.665817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-898437d2-c538-443c-a1a1-cdb5c308363f req-38ee84fb-7b08-491e-a299-f0b6a4a4443a service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:45.666189 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-898437d2-c538-443c-a1a1-cdb5c308363f req-38ee84fb-7b08-491e-a299-f0b6a4a4443a service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:45.677905 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-898437d2-c538-443c-a1a1-cdb5c308363f req-38ee84fb-7b08-491e-a299-f0b6a4a4443a service nova] Creating event network-vif-deleted:c9e1e5cf-8846-4eee-92f4-1074abb9dc36 for instance 213150a5-0351-4bb9-9ff3-b177abc6aede on hv-cinder-83602 Sep 01 05:34:45.682808 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-898437d2-c538-443c-a1a1-cdb5c308363f req-38ee84fb-7b08-491e-a299-f0b6a4a4443a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099468 Sep 01 05:34:45.683546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 340/704] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:34:46.669709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:46.670442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:46.672480 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:46.673222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:46.677699 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.678174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.678645 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.679528 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.680003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.680163 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.680525 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.680657 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.681098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.682044 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.682842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.683442 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.707847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:34:46.721220 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:46.721692 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:46.722118 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:46.722589 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lazy-loading 'fault' on Instance uuid 213150a5-0351-4bb9-9ff3-b177abc6aede {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:34:46.767556 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d01f65308f544b79d9c65e57705d9b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be72f5c9d9724a2a87a0a97c0d2d0cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:46.773225 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5c60e2f2-771f-44b2-b1dd-9f9005799b4a tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 200 len: 1309 microversion: 2.1 time: 0.106837 Sep 01 05:34:46.773792 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 341/705] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:46 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:47.041590 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-258b5c9b-6c31-4019-94fe-ddbcdc8d5804 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "DELETE /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 204 len: 0 microversion: 2.1 time: 0.377674 Sep 01 05:34:47.042216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 365/706] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:34:46 2022] DELETE /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:34:47.050372 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:47.051023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:47.058469 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.059046 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.059479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.060157 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.060603 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.061020 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.190822 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:47.198386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3ef0210b-e4e3-4453-bc50-3864bb1cdc03 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1508 microversion: 2.1 time: 0.151931 Sep 01 05:34:47.199052 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 342/707] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:47 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:47.793540 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:47.794227 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] [instance: 213150a5-0351-4bb9-9ff3-b177abc6aede] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:47.801216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.801679 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.802098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.802791 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:47.803228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:47.803637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:47.817542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] HTTP exception thrown: Instance 213150a5-0351-4bb9-9ff3-b177abc6aede could not be found. Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Request method failure captured: Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede HTTP/1.1 Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEPu65vnvIAfKvHf9HowDAD-9EwdgHnNQvMReD4h8VGfZOeY4IE6YyhkJW_D_1gQJ0ffSXMagRPVHHPko1Zi69d7IDxjbRlUVAeht9XH-JpMRiyRJNK_nKro98Bj48jDn1Gi6mdI4iWSwttuIJDlenbGiIlEVdjdUnhHFEbXakisQuo Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: be72f5c9d9724a2a87a0a97c0d2d0cd8 Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-VolumesSnapshotTestJSON-417643766 Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:34:47.831766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be72f5c9d9724a2a87a0a97c0d2d0cd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be72f5c9d9724a2a87a0a97c0d2d0cd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be72f5c9d9724a2a87a0a97c0d2d0cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be72f5c9d9724a2a87a0a97c0d2d0cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-VolumesSnapshotTestJSON-417643766 Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: be72f5c9d9724a2a87a0a97c0d2d0cd8 Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-417643766 Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-VolumesSnapshotTestJSON-417643766-project Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 9d01f65308f544b79d9c65e57705d9b7 Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-VolumesSnapshotTestJSON-417643766-project Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 213150a5-0351-4bb9-9ff3-b177abc6aede could not be found. Sep 01 05:34:47.833170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '213150a5-0351-4bb9-9ff3-b177abc6aede'} Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 213150a5-0351-4bb9-9ff3-b177abc6aede could not be found. Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:34:47.833952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 213150a5-0351-4bb9-9ff3-b177abc6aede could not be found. Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 213150a5-0351-4bb9-9ff3-b177abc6aede could not be found. Sep 01 05:34:47.835316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:47.836841 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] Returning 404 to user: Instance 213150a5-0351-4bb9-9ff3-b177abc6aede could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:34:47.836841 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ba5ddf7e-b826-4af4-9fd9-a0b0147e6b69 tempest-VolumesSnapshotTestJSON-417643766 tempest-VolumesSnapshotTestJSON-417643766-project] 10.222.0.16 "GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede" status: 404 len: 111 microversion: 2.1 time: 0.031199 Sep 01 05:34:47.836841 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 366/708] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:47 2022] GET /compute/v2.1/servers/213150a5-0351-4bb9-9ff3-b177abc6aede => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:34:48.219643 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:48.220244 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:48.227019 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:48.227537 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:48.229911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:48.229911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:48.229911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:48.229911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:48.361520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:48.369091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5527c8f2-ebe9-4578-a522-158a563c65f9 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1508 microversion: 2.1 time: 0.153884 Sep 01 05:34:48.369657 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 343/709] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:48 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:49.389054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:49.389592 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:49.396129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:49.396603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:49.397032 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.397706 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:49.398154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:49.398604 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:49.532181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:49.539869 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7925bff5-e635-4ee5-9d18-d38b53da01eb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1508 microversion: 2.1 time: 0.154750 Sep 01 05:34:49.540420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 367/710] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:49 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:50.561168 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:50.563324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:50.571998 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.572740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.573343 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.574216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.575053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.575625 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.614655 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-34072556-446b-4942-9ee3-05246c83a1ab req-b8708d91-d31d-4491-b163-2767578b6841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94115198-d3c1-40d0-af52-9c1dfe90a738", "name": "network-vif-deleted", "tag": "ac59538c-4a89-48a7-94e8-3ff1fb0219e9"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:50.628872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-34072556-446b-4942-9ee3-05246c83a1ab req-b8708d91-d31d-4491-b163-2767578b6841 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:50.628872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-34072556-446b-4942-9ee3-05246c83a1ab req-b8708d91-d31d-4491-b163-2767578b6841 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:50.628872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-34072556-446b-4942-9ee3-05246c83a1ab req-b8708d91-d31d-4491-b163-2767578b6841 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:50.638049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-34072556-446b-4942-9ee3-05246c83a1ab req-b8708d91-d31d-4491-b163-2767578b6841 service nova] Creating event network-vif-deleted:ac59538c-4a89-48a7-94e8-3ff1fb0219e9 for instance 94115198-d3c1-40d0-af52-9c1dfe90a738 on hv-cinder-83602 Sep 01 05:34:50.643860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-34072556-446b-4942-9ee3-05246c83a1ab req-b8708d91-d31d-4491-b163-2767578b6841 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032782 Sep 01 05:34:50.644456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 368/711] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:34:50.648078 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:50.655834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6fecd161-b78b-4b8b-8d5a-14849ef91a66 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1466 microversion: 2.1 time: 0.098624 Sep 01 05:34:50.656382 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 344/712] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:50 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1466 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:51.677491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:51.678186 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:51.684832 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.685309 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.685743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.686445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:51.687446 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:51.687872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:51.705585 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:51.752493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:51.760052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-77a7af4c-3cc9-493f-8869-8b696207f92a tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1466 microversion: 2.1 time: 0.086827 Sep 01 05:34:51.760611 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 369/713] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:51 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1466 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:52.781301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:52.781903 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:52.788357 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.788836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.789272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.789964 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:52.790508 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:52.790934 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:52.852684 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:52.860452 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e4d75cfd-19e8-410c-99d6-f2c3bff9998c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 200 len: 1293 microversion: 2.1 time: 0.083207 Sep 01 05:34:52.861018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 345/714] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:52 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:53.822629 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "502b1548-0868-4655-a1c7-ad4e9c49533f"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:53.824917 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:53.832193 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.832721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.833145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.833820 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.834264 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.834716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.881051 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:53.881749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: 94115198-d3c1-40d0-af52-9c1dfe90a738] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:53.888170 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.888712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.889207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.890595 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.891147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.891618 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.905775 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] HTTP exception thrown: Instance 94115198-d3c1-40d0-af52-9c1dfe90a738 could not be found. Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Request method failure captured: Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 HTTP/1.1 Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM7GY7-05XLd0TeVi-mcVC7JFpzwD-jwqAm6yzcGxeKORICry4_2jTuJQYxckn0sa8vpouuBW1fnYs3rPY-GaQbHyhvEk_-1nIDE-sJJM8vCdO4vhNdmvDpUWoSGqxuHQ21_3-0YRZeb7qQz0vWtun5hHwCroFjtoLhrIJL5KUEFPs Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:34:53.907838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: f4a01fadccd941fc98ecc99dac4e25c4 Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 94115198-d3c1-40d0-af52-9c1dfe90a738 could not be found. Sep 01 05:34:53.909500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '94115198-d3c1-40d0-af52-9c1dfe90a738'} Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94115198-d3c1-40d0-af52-9c1dfe90a738 could not be found. Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:34:53.910649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94115198-d3c1-40d0-af52-9c1dfe90a738 could not be found. Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94115198-d3c1-40d0-af52-9c1dfe90a738 could not be found. Sep 01 05:34:53.912176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.913673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Returning 404 to user: Instance 94115198-d3c1-40d0-af52-9c1dfe90a738 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:34:53.913673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a6f16899-1ec6-4a1c-9f98-13b2d46331fb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738" status: 404 len: 111 microversion: 2.1 time: 0.033134 Sep 01 05:34:53.913673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 346/715] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:53 2022] GET /compute/v2.1/servers/94115198-d3c1-40d0-af52-9c1dfe90a738 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:34:53.918549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:53.919138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:53.919362 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Invalid volume: volume 502b1548-0868-4655-a1c7-ad4e9c49533f is already attached to instances: a7840364-745b-43e2-988f-ad0069efa14a Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: POST /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments HTTP/1.1 Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 74 Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:34:53.921145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {"volumeAttachment": {"volumeId": "502b1548-0868-4655-a1c7-ad4e9c49533f"}} Sep 01 05:34:53.922637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Invalid volume: volume 502b1548-0868-4655-a1c7-ad4e9c49533f is already attached to instances: a7840364-745b-43e2-988f-ad0069efa14a Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'server_id': 'a7840364-745b-43e2-988f-ad0069efa14a', 'body': {'volumeAttachment': {'volumeId': '502b1548-0868-4655-a1c7-ad4e9c49533f'}}} Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 502b1548-0868-4655-a1c7-ad4e9c49533f is already attached to instances: a7840364-745b-43e2-988f-ad0069efa14a Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.923512 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 502b1548-0868-4655-a1c7-ad4e9c49533f is already attached to instances: a7840364-745b-43e2-988f-ad0069efa14a Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:34:53.924892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:34:53.926347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:34:53.926347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:34:53.926347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:34:53.926347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 502b1548-0868-4655-a1c7-ad4e9c49533f is already attached to instances: a7840364-745b-43e2-988f-ad0069efa14a Sep 01 05:34:53.926347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:34:53.926347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 400 to user: Invalid volume: volume 502b1548-0868-4655-a1c7-ad4e9c49533f is already attached to instances: a7840364-745b-43e2-988f-ad0069efa14a {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:34:53.926347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a476e0f4-be69-46d9-a7a8-f7180561a82e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104297 Sep 01 05:34:53.926347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 370/716] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:34:53 2022] POST /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:34:53.930540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.930540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.930540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.930540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:53.930872 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:53.930872 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:53.955739 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:34:53.999161 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:53.999867 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:54.006203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.007785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.008237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.008940 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.009394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.009817 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.093063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lazy-loading 'services' on Instance uuid a7840364-745b-43e2-988f-ad0069efa14a {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:34:54.255090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d6316695-47bb-41fb-9456-ad20c2fe5046 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 204 len: 0 microversion: 2.1 time: 0.339852 Sep 01 05:34:54.256138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 347/717] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:34:53 2022] DELETE /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:34:54.264278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:54.265676 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:54.271582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.272054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.272482 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.273157 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.273600 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.274014 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.340035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-425b9de8-8c14-400a-b857-a1116fc6a337 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments/502b1548-0868-4655-a1c7-ad4e9c49533f" status: 202 len: 0 microversion: 2.1 time: 0.344860 Sep 01 05:34:54.340861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 371/718] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:34:53 2022] DELETE /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments/502b1548-0868-4655-a1c7-ad4e9c49533f => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:34:54.349359 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:54.351787 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:54.359893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.360401 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.360852 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.361541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:54.361978 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:54.362393 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:54.393522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8ab43e79-befe-4057-a03e-fa760bdbb4c3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048388 Sep 01 05:34:54.394082 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 372/719] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:54 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:34:54.407966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:54.415759 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e0441bb3-2f43-4f9b-8c03-8879eb6f4c7d tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.155549 Sep 01 05:34:54.416321 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 348/720] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:54 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:55.405374 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:55.408233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:55.414571 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:55.415038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:55.415465 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.416137 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:55.416576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:55.416988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.436864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:55.437470 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:55.444020 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:55.444498 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:55.444930 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.445606 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:55.446053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:55.446491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:55.447853 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8e353f8e-947f-48f5-968d-6f983ffe95f2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046413 Sep 01 05:34:55.448408 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 373/721] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:55 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:55.580133 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:55.588019 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9b7cc647-0987-4aff-af67-59119bdede31 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.154928 Sep 01 05:34:55.588583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 349/722] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:55 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:34:56.459822 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:56.462002 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.470562 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.471037 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.471464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.472166 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.472641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.473126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.503173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e66194a9-b7e9-4cee-a847-213325721432 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047284 Sep 01 05:34:56.503726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 374/723] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:56 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:56.610133 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:56.610768 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:56.617316 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.617796 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.618227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.618942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:56.619393 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:56.619813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:56.624142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:56.751849 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:56.759626 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-315dbafc-1eb6-4779-876c-616e96081c15 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.154178 Sep 01 05:34:56.760197 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 350/724] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:56 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:57.516077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:57.518384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:57.524860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.525328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.525746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.526427 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.527000 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.527410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.557928 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b1a57faa-a458-4035-b742-fedb6c748943 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Sep 01 05:34:57.558703 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 375/725] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:57 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:57.781789 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:57.782400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:57.789318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.789794 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.790221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.790933 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:57.791383 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:57.791804 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:57.928935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:57.936793 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-59c89714-79b9-45d2-b178-7791e5cbc93f tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1521 microversion: 2.1 time: 0.159930 Sep 01 05:34:57.937432 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 351/726] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:57 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:58.570912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:58.573312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:58.580812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.584639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.584639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.584639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.584639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.585029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.616403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2cc40ffb-fabf-4ba0-bb2a-5eb059a5c8a7 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049520 Sep 01 05:34:58.617336 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 376/727] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:58 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:58.775278 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-2acc4134-fbdc-4660-98c4-4dddbb77cbee req-04c5e715-a454-4202-af2c-113cfeebac6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85c8e8e-97e2-4132-a090-67148112e3e2", "name": "network-vif-deleted", "tag": "2e24fdf5-3c73-4b91-a45c-ac8e7aac0e72"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:34:58.784712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-2acc4134-fbdc-4660-98c4-4dddbb77cbee req-04c5e715-a454-4202-af2c-113cfeebac6e service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.785674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-2acc4134-fbdc-4660-98c4-4dddbb77cbee req-04c5e715-a454-4202-af2c-113cfeebac6e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.785674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-2acc4134-fbdc-4660-98c4-4dddbb77cbee req-04c5e715-a454-4202-af2c-113cfeebac6e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.797040 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-2acc4134-fbdc-4660-98c4-4dddbb77cbee req-04c5e715-a454-4202-af2c-113cfeebac6e service nova] Creating event network-vif-deleted:2e24fdf5-3c73-4b91-a45c-ac8e7aac0e72 for instance e85c8e8e-97e2-4132-a090-67148112e3e2 on hv-cinder-83602 Sep 01 05:34:58.802047 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-2acc4134-fbdc-4660-98c4-4dddbb77cbee req-04c5e715-a454-4202-af2c-113cfeebac6e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030303 Sep 01 05:34:58.802652 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 352/728] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:34:58.957121 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:58.957741 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:58.965354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.966464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.966464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:58.966998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:58.967448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:58.967860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.032521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:34:59.040449 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-aa649a28-6fd1-444d-a73c-04d0e9e05ed6 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1306 microversion: 2.1 time: 0.087321 Sep 01 05:34:59.041052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 377/729] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:34:58 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1306 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:34:59.629628 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:59.631892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:59.638259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.638770 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.639206 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.639898 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.640347 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.640768 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.670147 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-94713c9d-2b22-499c-b5f8-8aa081a6f3e3 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044978 Sep 01 05:34:59.670735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 353/730] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:34:59 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:34:59.731921 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:34:59.732445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:34:59.738909 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.739387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.739821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.740506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:34:59.740954 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:34:59.741375 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:34:59.766982 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:35:00.036124 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e88b6b1a-2a9e-490c-b21a-6961a14e92a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 204 len: 0 microversion: 2.1 time: 0.307780 Sep 01 05:35:00.036792 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 378/731] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:34:59 2022] DELETE /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:35:00.045103 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:00.045715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:00.051960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.052435 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.052864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.053548 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.053988 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.054428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.061340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:00.062057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:00.068613 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.072844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.072844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.072844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.072844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.073235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.103108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:00.103575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:00.104042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:00.104477 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'fault' on Instance uuid e85c8e8e-97e2-4132-a090-67148112e3e2 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:00.145750 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:00.153520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-19309fac-5ce9-4ba5-ad6c-33b89bde5df0 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1311 microversion: 2.1 time: 0.096310 Sep 01 05:35:00.154088 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 379/732] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:00 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:00.185005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:00.193662 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3e264a48-0f1b-458c-9543-f9161d7c2815 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1682 microversion: 2.1 time: 0.152400 Sep 01 05:35:00.194225 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 354/733] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:00 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:01.181426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:01.182038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:01.188555 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.189282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.189707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.190381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.190852 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.191270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.215941 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:01.216541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:01.223117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.223546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.223676 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.224015 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.224157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.224465 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'fault' on Instance uuid e85c8e8e-97e2-4132-a090-67148112e3e2 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:01.224580 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.225202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:01.225649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:01.226059 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:01.264151 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:01.272748 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c128b59f-5ca8-4a86-81fd-065f4441e7dc tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1311 microversion: 2.1 time: 0.095302 Sep 01 05:35:01.273418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 380/734] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:01 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:01.359213 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:01.366837 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-bb63b87b-0d00-4023-bbd6-61f2ab509ecb tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1682 microversion: 2.1 time: 0.154789 Sep 01 05:35:01.376827 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 355/735] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:01 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:02.294114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:02.294818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:02.301794 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.302268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.302738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.303579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.304015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.304436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.336098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.336499 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.336928 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.337372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'fault' on Instance uuid e85c8e8e-97e2-4132-a090-67148112e3e2 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:02.380412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.388247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-79702a6e-6fca-49f0-bd7a-62799f58002c tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1311 microversion: 2.1 time: 0.098225 Sep 01 05:35:02.388431 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:02.388842 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 381/736] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:02 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:02.388939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:02.391318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:02.396028 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.396519 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.396931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.397607 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:02.398051 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:02.398500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:02.524790 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:02.532704 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-41f47cc8-34bf-42e0-8161-b36b6b3cfd3c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1682 microversion: 2.1 time: 0.148198 Sep 01 05:35:02.533274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 356/737] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:02 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:03.408955 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.409556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.415908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.416378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.416798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.417473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.417914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.418331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.450353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.450875 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.451361 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.451794 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lazy-loading 'fault' on Instance uuid e85c8e8e-97e2-4132-a090-67148112e3e2 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:03.454661 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:03.554033 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:03.554711 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:03.562682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.568324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.568324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.568324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:03.568324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:03.568715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:03.715481 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:03.726684 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0fd7c93e-82e6-4688-8433-7d1c7dfa88cc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1682 microversion: 2.1 time: 0.176442 Sep 01 05:35:03.728260 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 357/738] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:03 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:03.740707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4a01fadccd941fc98ecc99dac4e25c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b34f5b5ce7c44930b3c85701d9ceb384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:03.749049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-387bd9ce-59ea-46a1-b434-1e1db492b3cb tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 200 len: 1311 microversion: 2.1 time: 0.343542 Sep 01 05:35:03.749627 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 382/739] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:03 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 1311 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:04.749163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:04.751091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:04.758777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.759337 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.759782 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.760484 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.760938 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.761365 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.770852 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:04.771787 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] [instance: e85c8e8e-97e2-4132-a090-67148112e3e2] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:04.785355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.785355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.785788 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.787415 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:04.788122 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:04.788792 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:04.806601 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] HTTP exception thrown: Instance e85c8e8e-97e2-4132-a090-67148112e3e2 could not be found. Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Request method failure captured: Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 HTTP/1.1 Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM7GY7-05XLd0TeVi-mcVC7JFpzwD-jwqAm6yzcGxeKORICry4_2jTuJQYxckn0sa8vpouuBW1fnYs3rPY-GaQbHyhvEk_-1nIDE-sJJM8vCdO4vhNdmvDpUWoSGqxuHQ21_3-0YRZeb7qQz0vWtun5hHwCroFjtoLhrIJL5KUEFPs Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:35:04.811995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b34f5b5ce7c44930b3c85701d9ceb384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: b34f5b5ce7c44930b3c85701d9ceb384 Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2035640204 Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: f4a01fadccd941fc98ecc99dac4e25c4 Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2035640204-project Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance e85c8e8e-97e2-4132-a090-67148112e3e2 could not be found. Sep 01 05:35:04.814173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'e85c8e8e-97e2-4132-a090-67148112e3e2'} Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85c8e8e-97e2-4132-a090-67148112e3e2 could not be found. Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:04.815353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85c8e8e-97e2-4132-a090-67148112e3e2 could not be found. Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85c8e8e-97e2-4132-a090-67148112e3e2 could not be found. Sep 01 05:35:04.816615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:04.824510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] Returning 404 to user: Instance e85c8e8e-97e2-4132-a090-67148112e3e2 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:04.824510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5b0e4a8d-c77d-4ee6-bf2a-fda840545a81 tempest-ServerRescueNegativeTestJSON-2035640204 tempest-ServerRescueNegativeTestJSON-2035640204-project] 10.222.0.16 "GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2" status: 404 len: 111 microversion: 2.1 time: 0.045066 Sep 01 05:35:04.824510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 383/740] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:04 2022] GET /compute/v2.1/servers/e85c8e8e-97e2-4132-a090-67148112e3e2 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:35:04.893393 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:04.901652 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-469164a5-2c49-4440-80e9-1289fca70807 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1614 microversion: 2.1 time: 0.157303 Sep 01 05:35:04.902241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 358/741] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:04 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1614 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:05.003795 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-f02f45bf-bbcd-4c04-96bb-13dc7003aa54 req-2d28c301-b1e5-4255-a183-3a536ee0b96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7840364-745b-43e2-988f-ad0069efa14a", "name": "network-vif-deleted", "tag": "ca36b374-0cc7-4c8e-9fd9-d64396ae32dd"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:05.013069 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-f02f45bf-bbcd-4c04-96bb-13dc7003aa54 req-2d28c301-b1e5-4255-a183-3a536ee0b96e service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.013546 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-f02f45bf-bbcd-4c04-96bb-13dc7003aa54 req-2d28c301-b1e5-4255-a183-3a536ee0b96e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.013976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-f02f45bf-bbcd-4c04-96bb-13dc7003aa54 req-2d28c301-b1e5-4255-a183-3a536ee0b96e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.026083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-f02f45bf-bbcd-4c04-96bb-13dc7003aa54 req-2d28c301-b1e5-4255-a183-3a536ee0b96e service nova] Creating event network-vif-deleted:ca36b374-0cc7-4c8e-9fd9-d64396ae32dd for instance a7840364-745b-43e2-988f-ad0069efa14a on hv-cinder-83602 Sep 01 05:35:05.031047 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-f02f45bf-bbcd-4c04-96bb-13dc7003aa54 req-2d28c301-b1e5-4255-a183-3a536ee0b96e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030936 Sep 01 05:35:05.032218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 384/742] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:05.923276 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:05.923895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:05.930594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.931072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.931531 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.932262 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.932705 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.933116 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.968188 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:05.968755 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:05.971361 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:05.971361 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lazy-loading 'fault' on Instance uuid a7840364-745b-43e2-988f-ad0069efa14a {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:06.011575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:06.020191 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-94a30a91-6e4c-43ad-9d3d-30f52372ebfd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 200 len: 1331 microversion: 2.1 time: 0.100835 Sep 01 05:35:06.026341 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 359/743] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:05 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:07.043118 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:07.043984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:07.050895 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.051477 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.053936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.053936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:07.053936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:07.053936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:07.067997 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a HTTP/1.1 Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:35:07.069628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:35:07.071075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'a7840364-745b-43e2-988f-ad0069efa14a'} Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:07.072851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:35:07.074074 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:07.076619 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:07.076619 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3cad732f-5329-47bb-a36b-a5ead538d7a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 404 len: 111 microversion: 2.1 time: 0.033457 Sep 01 05:35:07.076619 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 385/744] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:07 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:07.080434 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-22426c60-29ea-4aa4-be96-2e76ea49afc2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '.version_select at 0x7f953b10f3a0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:07.172745 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-22426c60-29ea-4aa4-be96-2e76ea49afc2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-575016847" status: 202 len: 0 microversion: 2.1 time: 0.096422 Sep 01 05:35:07.173404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 360/745] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 1 05:35:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-575016847 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:35:08.118583 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e5e60e57-948b-4f0e-8430-a1f0f397d308 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: .version_select at 0x7f953ae443a0>, body: {"keypair": {"name": "tempest-keypair-63666867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAxvCbyQeeshNy0JMrcbEG55iio+aeR+0looVtN3/hg5Aa5R7w7SAjb/LklBVWucECQSjHzSpI9v53B/Yqw73faBwnowahZr8Yd6NcDr8CfQseS65MfVLffYrZFhVqdyA=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:08.137924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-e5e60e57-948b-4f0e-8430-a1f0f397d308 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for project 1a200065c13e42babe6353689aabd896. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:35:08.142443 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-e5e60e57-948b-4f0e-8430-a1f0f397d308 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for user 11770fbaeacd4fc7bc4052e83630dbb3 and project 1a200065c13e42babe6353689aabd896. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:35:08.236382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e5e60e57-948b-4f0e-8430-a1f0f397d308 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.122236 Sep 01 05:35:08.236955 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 386/746] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:35:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:10.907837 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-610123435", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00c5deda-d635-4d45-9035-2f4ba75e32f9"}], "security_groups": [{"name": "tempest-securitygroup--806956617"}], "key_name": "tempest-keypair-63666867", "user_data": "}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:11.020041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] validate_networks() for [('00c5deda-d635-4d45-9035-2f4ba75e32f9', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:35:11.464708 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:35:11.465963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:35:11.465963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:35:11.468091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:35:11.468738 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:35:11.482727 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.483599 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.484277 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.485688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:11.486305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:11.486904 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:11.511585 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for project 1a200065c13e42babe6353689aabd896. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:35:11.519616 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Getting quotas for user 11770fbaeacd4fc7bc4052e83630dbb3 and project 1a200065c13e42babe6353689aabd896. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:35:11.531712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:35:11.534234 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:35:11.859813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1bdba11f-0785-49ba-8b7a-502f3b992aa1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.955788 Sep 01 05:35:11.866713 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 361/747] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:35:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:35:11.872082 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-29901fd9-1b67-455c-b65f-c5bf4a95fe7e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:11.872925 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-29901fd9-1b67-455c-b65f-c5bf4a95fe7e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:11.964610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-29901fd9-1b67-455c-b65f-c5bf4a95fe7e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:11.972360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-29901fd9-1b67-455c-b65f-c5bf4a95fe7e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1239 microversion: 2.1 time: 0.103954 Sep 01 05:35:11.972939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 362/748] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:11 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1239 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:12.022147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:12.022642 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:12.030390 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.031084 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.031344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.032025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:12.032468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:12.032879 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:12.056760 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bd942e91-43ef-4c10-a06f-894087d3a0ef tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/ips" status: 200 len: 151 microversion: 2.20 time: 0.265996 Sep 01 05:35:12.057610 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 387/749] 10.222.0.16 () {60 vars in 1289 bytes} [Thu Sep 1 05:35:11 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/ips => generated 151 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 05:35:12.992924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:12.996964 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:13.015368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.018010 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.018644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.022421 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:13.022901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:13.023332 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:13.153896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:13.162641 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-31a3f1e2-d0d8-4215-bbc9-5eeac3c6e6b8 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1243 microversion: 2.1 time: 0.173636 Sep 01 05:35:13.163362 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 363/750] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:12 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1243 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:14.183180 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:14.183776 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:14.191798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.192266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.192910 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.193593 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.194205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.194676 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.266578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:14.276170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0ea8f473-7a4d-407b-9b4b-99b4fd456e1b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1291 microversion: 2.1 time: 0.096553 Sep 01 05:35:14.277034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 388/751] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:14 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1291 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:14.414446 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:14.415620 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:14.422336 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.423423 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.423423 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.426169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:14.426169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:14.426169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:14.456040 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lazy-loading 'flavor' on Instance uuid f0e750cb-b7bf-46f8-945d-51866ebb4c2e {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:15.146216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ab17dd33-4c75-4123-bffd-1ff374009393 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/action" status: 202 len: 0 microversion: 2.20 time: 0.734518 Sep 01 05:35:15.147431 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 364/752] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 1 05:35:14 2022] POST /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:35:15.159433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:15.160555 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:15.168718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:15.169352 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:15.169908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.170813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:15.171356 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:15.172766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.304332 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:15.305065 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:15.312627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:15.317005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:15.317005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.317005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:15.317005 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:15.317403 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:15.343130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.352820 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.354282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.355691 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-26c86a8e-641a-4b73-985a-b3b886935629 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.202499 Sep 01 05:35:15.356258 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 389/753] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:15 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:15.443448 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:15.451188 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b8e483d7-f9b9-46b2-a563-1aca448679c5 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1297 microversion: 2.1 time: 0.151150 Sep 01 05:35:15.451755 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 365/754] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:15 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1297 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:16.377809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:16.378443 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:16.398423 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.400278 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.400971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.402100 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.415460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.415460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.474098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:16.475349 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:16.484981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.485870 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.486557 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.487669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:16.488505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:16.489179 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:16.592285 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.602566 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.604925 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.606141 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5fd5b0b7-a1ee-4fdb-8d25-62ab4fb5f2d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.232723 Sep 01 05:35:16.606972 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 390/755] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:16 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:16.855849 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:16.869387 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9d3dc03e-0b90-43a3-b274-c6fe64684c45 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.400716 Sep 01 05:35:16.870961 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 366/756] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:16 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:17.497410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-225ff030-0645-4354-bdd8-d169fdc6af57 req-68a6d06f-e197-4952-a9ff-ec6c60cf68bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12eed38-21c3-4708-bcb4-9901084f5749", "tag": "06a7f01a-720b-4986-a3d4-62ab8bc5e8ec"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:17.520072 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:17.521906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-225ff030-0645-4354-bdd8-d169fdc6af57 req-68a6d06f-e197-4952-a9ff-ec6c60cf68bf service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.522315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-225ff030-0645-4354-bdd8-d169fdc6af57 req-68a6d06f-e197-4952-a9ff-ec6c60cf68bf service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.528024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-225ff030-0645-4354-bdd8-d169fdc6af57 req-68a6d06f-e197-4952-a9ff-ec6c60cf68bf service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.543116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-225ff030-0645-4354-bdd8-d169fdc6af57 req-68a6d06f-e197-4952-a9ff-ec6c60cf68bf service nova] Creating event network-changed:06a7f01a-720b-4986-a3d4-62ab8bc5e8ec for instance b12eed38-21c3-4708-bcb4-9901084f5749 on hv-cinder-83602 Sep 01 05:35:17.548725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-225ff030-0645-4354-bdd8-d169fdc6af57 req-68a6d06f-e197-4952-a9ff-ec6c60cf68bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055537 Sep 01 05:35:17.549771 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 391/757] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:17.638446 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:17.639632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:17.673084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.675887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.676996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.678255 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.678956 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.681752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.902395 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:17.903413 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:17.911699 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.912336 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.912768 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:17.913463 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:17.913936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:17.914303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:18.060940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:18.068623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:18.074055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:18.078876 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:18.080418 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cc157116-d9d9-445c-9670-3f1d536291b7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.450051 Sep 01 05:35:18.094828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:18.095728 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 367/758] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:17 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:18.103407 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7b275f46-49de-457d-91e5-093c5329e866 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.211071 Sep 01 05:35:18.107793 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 392/759] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:17 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:18.335975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-afad8bea-48e0-48f6-92d2-28abf52da378 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'create', calling method: .version_select at 0x7f953af82430>, body: {"keypair": {"name": "tempest-keypair-1800586145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnWW/Dt7vtPXuxPtkT5VEzjSzDSjAoE16ZmyHO/CkaV80qPRqoKhDl+ar42+QVBzZIJjATdKnsaFSE4k+Bl0NU4/nQBCuMcRXQebJz/yfnr4SMBdPLfkflUxSHErN/lhA=="}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:18.352604 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-afad8bea-48e0-48f6-92d2-28abf52da378 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Getting quotas for project fdee9665c45d41be9d34ba14def64757. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:35:18.356842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-afad8bea-48e0-48f6-92d2-28abf52da378 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Getting quotas for user 9561f323e125411bb83ecce21bb085c0 and project fdee9665c45d41be9d34ba14def64757. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:35:18.446342 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-afad8bea-48e0-48f6-92d2-28abf52da378 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.246922 Sep 01 05:35:18.447023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 368/760] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:35:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:19.105029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:19.105555 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:19.107451 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:19.112779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.113245 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.113664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.114339 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.114829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.115264 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.124590 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:19.125813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:19.136596 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.137394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.138030 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.139026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:19.139780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:19.140916 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:19.273565 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.283416 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.285109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.286805 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d7a4b154-10ee-4d09-bac4-21d33e4ed3a0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.186021 Sep 01 05:35:19.287729 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 393/761] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:19 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:19.311602 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:19.319606 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-30cac747-634f-4401-84a9-7575436bc8a2 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.199258 Sep 01 05:35:19.320180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 369/762] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:19 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:20.313420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:20.314753 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:20.323436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.324030 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.324578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.325373 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.325919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.326439 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.347233 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:20.347848 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:20.357051 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.357532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.357960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.359335 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:20.359934 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:20.360316 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:20.498881 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.499041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.507259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-06b1f164-7791-410c-9268-e2f445b869c6 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.169475 Sep 01 05:35:20.507826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 370/763] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:20 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:20.508057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.509777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:20.514075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cc40450e-0c7a-4aaa-8e73-ff9db52a4aaa tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.204130 Sep 01 05:35:20.517114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 394/764] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:20 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:21.037996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2126002450", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "348291c1-9b67-43d8-9d29-6df8cb41ef80"}], "security_groups": [{"name": "tempest-securitygroup--832114108"}], "key_name": "tempest-keypair-1800586145", "user_data": "}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:21.154743 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] validate_networks() for [('348291c1-9b67-43d8-9d29-6df8cb41ef80', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:35:21.313061 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1027333113"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:21.313584 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:21.320452 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.320937 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.321373 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.322140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.322890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.323360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.458906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.network.security_group_api [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Removing security group bfbe1e07-cb9b-4f26-89d7-de5d5f633831 from port bd7c102d-defb-4763-8b8b-49ff53fc8472 Sep 01 05:35:21.500229 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:21.782430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:35:21.782842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:35:21.783305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:35:21.783732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:35:21.784138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:35:21.792821 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.793311 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.793714 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.794470 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.794917 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.795329 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.811894 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Getting quotas for project fdee9665c45d41be9d34ba14def64757. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:35:21.816090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Getting quotas for user 9561f323e125411bb83ecce21bb085c0 and project fdee9665c45d41be9d34ba14def64757. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:35:21.826808 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:35:21.829123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:35:21.861895 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-25ca5bd0-d5f0-401d-9316-ce25b630412e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "POST /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/action" status: 202 len: 0 microversion: 2.1 time: 0.553665 Sep 01 05:35:21.862958 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 395/765] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:35:21 2022] POST /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:35:21.868030 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:21.868654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:21.876433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.877237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.877727 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.883203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:21.883203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:21.883203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:21.983294 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1cfbf58f-a4cb-4c7c-a0e8-ff93d5441882 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.949751 Sep 01 05:35:21.988207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 371/766] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:35:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:35:22.001644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:22.002274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:22.012615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.012615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.012615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.012912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.013185 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.013646 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.080604 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.089929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-eebc67ba-2532-4868-ad41-c2978c929dc1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.224266 Sep 01 05:35:22.090552 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 396/767] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:21 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:22.180266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-8c63ec9d-39a4-4304-8e7b-d030221101c1 req-e99016b0-f7f9-42ce-8ca0-3eb2c09ae883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e5b578-ab03-48a7-9272-9432987ef817", "tag": "bd7c102d-defb-4763-8b8b-49ff53fc8472"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:22.193848 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8c63ec9d-39a4-4304-8e7b-d030221101c1 req-e99016b0-f7f9-42ce-8ca0-3eb2c09ae883 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:22.194597 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8c63ec9d-39a4-4304-8e7b-d030221101c1 req-e99016b0-f7f9-42ce-8ca0-3eb2c09ae883 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:22.196299 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.196447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-8c63ec9d-39a4-4304-8e7b-d030221101c1 req-e99016b0-f7f9-42ce-8ca0-3eb2c09ae883 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:22.205465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.207280 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.208652 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c94ab254-fd98-4272-abca-65647af8586c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.219221 Sep 01 05:35:22.209201 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 372/768] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:21 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:22.210010 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-8c63ec9d-39a4-4304-8e7b-d030221101c1 req-e99016b0-f7f9-42ce-8ca0-3eb2c09ae883 service nova] Creating event network-changed:bd7c102d-defb-4763-8b8b-49ff53fc8472 for instance f5e5b578-ab03-48a7-9272-9432987ef817 on hv-cinder-83602 Sep 01 05:35:22.214439 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-17c8022e-287d-497e-9f68-775fa6d99172 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:22.215300 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-17c8022e-287d-497e-9f68-775fa6d99172 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:22.219281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-8c63ec9d-39a4-4304-8e7b-d030221101c1 req-e99016b0-f7f9-42ce-8ca0-3eb2c09ae883 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126144 Sep 01 05:35:22.220824 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 397/769] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:22.316206 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-17c8022e-287d-497e-9f68-775fa6d99172 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:22.323644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-17c8022e-287d-497e-9f68-775fa6d99172 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1238 microversion: 2.1 time: 0.113292 Sep 01 05:35:22.325974 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 373/770] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:22 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:23.116169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.116971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.123770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.125158 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.125680 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.126449 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.126977 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.127474 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.234818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.235520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.244043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.244579 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.245071 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.246093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.246732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.247311 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.351580 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.360924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3891dcb5-2ca3-4bc9-9da6-09a7613728e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.249080 Sep 01 05:35:23.374645 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 398/771] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:23 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:23.374645 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.374645 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.376261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.376739 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.377165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.377876 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.378824 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.378824 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.410889 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.410889 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.411121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.412379 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5ade0c0c-dae1-4884-a26b-d59f071c87ab tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.183130 Sep 01 05:35:23.413260 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 374/772] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:23 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:23.477192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:23.487870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b27721bd-cab3-4496-ae0e-d1c8f66a562b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1242 microversion: 2.1 time: 0.124347 Sep 01 05:35:23.488535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 399/773] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:23 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:23.657889 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:23.658489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:23.664550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.665256 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.665687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.666374 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:23.666878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:23.667296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:23.752832 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lazy-loading 'services' on Instance uuid f5e5b578-ab03-48a7-9272-9432987ef817 {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:35:24.019952 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c48099d0-a74c-4891-85a6-bad6255ce18b tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments/84a32abc-4e28-46e3-b559-73d672ba4fd1" status: 202 len: 0 microversion: 2.1 time: 0.363457 Sep 01 05:35:24.019952 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 375/774] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:35:23 2022] DELETE /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments/84a32abc-4e28-46e3-b559-73d672ba4fd1 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:35:24.026434 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:24.028647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:24.034682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.035156 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.035582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.036265 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.036711 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.037167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.069976 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bd553de6-792b-435a-8812-8c4cb44ff575 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048072 Sep 01 05:35:24.071286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 400/775] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:35:24 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:24.238900 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-cf3df9cd-3f26-4387-ba4e-2d7a6c9fca14 req-826164d2-2c7f-4226-998e-a2e54aa8c32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e5b578-ab03-48a7-9272-9432987ef817", "tag": "bd7c102d-defb-4763-8b8b-49ff53fc8472"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:24.257687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-cf3df9cd-3f26-4387-ba4e-2d7a6c9fca14 req-826164d2-2c7f-4226-998e-a2e54aa8c32c service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.259446 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-cf3df9cd-3f26-4387-ba4e-2d7a6c9fca14 req-826164d2-2c7f-4226-998e-a2e54aa8c32c service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.259446 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-cf3df9cd-3f26-4387-ba4e-2d7a6c9fca14 req-826164d2-2c7f-4226-998e-a2e54aa8c32c service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.271257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-cf3df9cd-3f26-4387-ba4e-2d7a6c9fca14 req-826164d2-2c7f-4226-998e-a2e54aa8c32c service nova] Creating event network-changed:bd7c102d-defb-4763-8b8b-49ff53fc8472 for instance f5e5b578-ab03-48a7-9272-9432987ef817 on hv-cinder-83602 Sep 01 05:35:24.276095 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-cf3df9cd-3f26-4387-ba4e-2d7a6c9fca14 req-826164d2-2c7f-4226-998e-a2e54aa8c32c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041157 Sep 01 05:35:24.276966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 376/776] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:24.381376 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:24.381981 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:24.388858 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.389478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.390096 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.391097 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.391585 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.392055 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.437669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:24.442151 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:24.448976 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.449482 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.449915 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.450661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.451114 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.451538 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.538542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.547241 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2ff2dabf-dc55-49f8-ba89-0fa1778137e1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.169708 Sep 01 05:35:24.560974 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 401/777] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:24 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:24.567257 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:24.568053 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:24.574641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.575346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.575934 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.576771 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:24.577425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:24.578022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:24.650956 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.660526 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5f142a7f-aa4c-4609-9107-9d33bb4be931 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1290 microversion: 2.1 time: 0.097250 Sep 01 05:35:24.661648 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 402/778] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:24 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:24.746840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.752759 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.754568 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:24.755950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-71520f12-ae38-4ee3-8813-b971667f8c34 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.323588 Sep 01 05:35:24.756582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 377/779] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:24 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:25.085230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:25.089584 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:25.114321 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.117137 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.117137 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.117716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.118177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.122353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.174332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f61fe845-cadb-4653-a6d9-bf0f7c6d62d4 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094499 Sep 01 05:35:25.175305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 403/780] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:35:25 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:35:25.295123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-2af8039a-acf7-4597-82e2-08b08192414f req-712c388f-22e8-4350-8001-01e018d2965d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12eed38-21c3-4708-bcb4-9901084f5749", "name": "network-vif-plugged", "status": "completed", "tag": "06a7f01a-720b-4986-a3d4-62ab8bc5e8ec"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:25.304662 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-2af8039a-acf7-4597-82e2-08b08192414f req-712c388f-22e8-4350-8001-01e018d2965d service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.305279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-2af8039a-acf7-4597-82e2-08b08192414f req-712c388f-22e8-4350-8001-01e018d2965d service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.310873 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-2af8039a-acf7-4597-82e2-08b08192414f req-712c388f-22e8-4350-8001-01e018d2965d service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.317217 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-2af8039a-acf7-4597-82e2-08b08192414f req-712c388f-22e8-4350-8001-01e018d2965d service nova] Creating event network-vif-plugged:06a7f01a-720b-4986-a3d4-62ab8bc5e8ec for instance b12eed38-21c3-4708-bcb4-9901084f5749 on hv-cinder-83602 Sep 01 05:35:25.322164 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-2af8039a-acf7-4597-82e2-08b08192414f req-712c388f-22e8-4350-8001-01e018d2965d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092492 Sep 01 05:35:25.323129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 378/781] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:25.568874 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:25.569420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:25.575911 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.576387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.576884 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.578157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.578637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.579063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.583221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:25.686854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:25.688172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:25.700714 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.706082 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.706082 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.706082 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.706082 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.706651 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.791096 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:25.799449 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7dc854a7-d2a5-4713-97d6-df5007245e43 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.234571 Sep 01 05:35:25.800460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 404/782] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:25 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:25.805091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:25.805687 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:25.811974 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.812705 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.813135 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.813815 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:25.814258 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:25.814788 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:25.833518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:25.842936 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a68aa397-31d8-498a-9b21-d95dae0b10b6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1296 microversion: 2.1 time: 0.160681 Sep 01 05:35:25.843763 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 379/783] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:25 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1296 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:26.034328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.042639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.044125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.045275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f28be167-0235-4a04-8cef-d20caf1efcdd tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.243790 Sep 01 05:35:26.050966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 405/784] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:25 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:26.186121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:26.189343 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:26.196698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.197307 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.197842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.198671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.199256 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.199812 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.230903 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b3a48e49-4cf2-4708-932a-9ce01a65b1c3 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048665 Sep 01 05:35:26.239404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 380/785] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:35:26 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:35:26.243234 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:26.243734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:26.252618 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.253114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.253606 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.256859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.257790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.258891 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.353766 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] HTTP exception thrown: Instance f5e5b578-ab03-48a7-9272-9432987ef817 is not attached to volume 84a32abc-4e28-46e3-b559-73d672ba4fd1 Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Request method failure captured: Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments/84a32abc-4e28-46e3-b559-73d672ba4fd1 HTTP/1.1 Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEP3QRyIz7Z55jGwBYcbX4zKAZwF7iDx-32wB9JPtybha4qvLWknnmw8iUaZPEC0eE_-TtCQCB7jhUxIxzXbHRTdxBALgZaeSpsp3BJbh1oCgaUzX9ppKHUoLbefnwGizbqQFYnwxKh5HKOLzY7pkpAO3KReZmJBew4AbI0N57-Gofo Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 924b0db81eb1479e9bea0f8a60d66526 Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestMinimumBasicScenario-1484952582 Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:35:26.356387 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/924b0db81eb1479e9bea0f8a60d66526"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/924b0db81eb1479e9bea0f8a60d66526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_924b0db81eb1479e9bea0f8a60d66526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/924b0db81eb1479e9bea0f8a60d66526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestMinimumBasicScenario-1484952582 Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 924b0db81eb1479e9bea0f8a60d66526 Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1484952582 Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-TestMinimumBasicScenario-1484952582-project Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 4e9d9a240b824236aa40a3d03922b51d Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestMinimumBasicScenario-1484952582-project Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:35:26.358086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance f5e5b578-ab03-48a7-9272-9432987ef817 is not attached to volume 84a32abc-4e28-46e3-b559-73d672ba4fd1 Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'server_id': 'f5e5b578-ab03-48a7-9272-9432987ef817', 'id': '84a32abc-4e28-46e3-b559-73d672ba4fd1'} Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 84a32abc-4e28-46e3-b559-73d672ba4fd1. Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:26.359535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e5b578-ab03-48a7-9272-9432987ef817 is not attached to volume 84a32abc-4e28-46e3-b559-73d672ba4fd1 Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e5b578-ab03-48a7-9272-9432987ef817 is not attached to volume 84a32abc-4e28-46e3-b559-73d672ba4fd1 Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:26.361146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Returning 404 to user: Instance f5e5b578-ab03-48a7-9272-9432987ef817 is not attached to volume 84a32abc-4e28-46e3-b559-73d672ba4fd1 {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:26.362305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3a27b228-5a76-44d5-9da1-e4b3f508e6f2 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments/84a32abc-4e28-46e3-b559-73d672ba4fd1" status: 404 len: 154 microversion: 2.1 time: 0.118697 Sep 01 05:35:26.362305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 406/786] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:35:26 2022] DELETE /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817/os-volume_attachments/84a32abc-4e28-46e3-b559-73d672ba4fd1 => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:35:26.821793 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:26.822420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:26.825039 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:26.830392 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.831207 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.831645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.832434 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.832966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.833386 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.863912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:26.864740 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:26.882212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.882743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.883168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.883866 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:26.884316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:26.884735 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:26.979631 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:26.986484 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d1ba9d3b-50ac-47ca-8ced-a69baeac9063 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1364 microversion: 2.1 time: 0.168673 Sep 01 05:35:26.987139 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 381/787] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:26 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:27.024433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.032371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7cc1fcf9-a5d3-49ec-aa71-7c235594604d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.172309 Sep 01 05:35:27.032939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 407/788] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:26 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:27.069272 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:27.069985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:27.076327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.076905 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.077900 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.078629 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.079084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.079497 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.215725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.224407 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.225834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:27.227083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-74a4b702-edc6-4a7a-8f99-73b1bde1dfc2 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.162173 Sep 01 05:35:27.227661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 382/789] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:27 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:27.324378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-812c22cd-3f68-4a59-9564-23671e31b525 req-753248c4-b4c8-454f-ad9e-acc5e0d66210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52f30586-8ff8-4c6a-844d-dd76b18c6656", "tag": "109dec1a-0199-46f8-abd0-b6c564581a6b"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:27.335958 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-812c22cd-3f68-4a59-9564-23671e31b525 req-753248c4-b4c8-454f-ad9e-acc5e0d66210 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.336434 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-812c22cd-3f68-4a59-9564-23671e31b525 req-753248c4-b4c8-454f-ad9e-acc5e0d66210 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.336865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-812c22cd-3f68-4a59-9564-23671e31b525 req-753248c4-b4c8-454f-ad9e-acc5e0d66210 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.349328 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-812c22cd-3f68-4a59-9564-23671e31b525 req-753248c4-b4c8-454f-ad9e-acc5e0d66210 service nova] Creating event network-changed:109dec1a-0199-46f8-abd0-b6c564581a6b for instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 on hv-cinder-83602 Sep 01 05:35:27.354421 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-812c22cd-3f68-4a59-9564-23671e31b525 req-753248c4-b4c8-454f-ad9e-acc5e0d66210 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033715 Sep 01 05:35:27.356066 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 408/790] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:35:27.648022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:27.648517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:27.655555 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.656042 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.656474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.657184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:27.657703 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:27.658126 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:27.685137 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:35:27.993390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0b0de417-6b96-4e59-8ebe-75a891a6cec8 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 204 len: 0 microversion: 2.1 time: 0.349024 Sep 01 05:35:27.994316 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 383/791] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:35:27 2022] DELETE /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:35:28.003861 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.005230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.008613 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.009507 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.011721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.012195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.012860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.013729 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.014338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.014945 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.015885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.016522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.017132 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.018175 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.018763 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.020770 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.157419 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.157572 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.165344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a10d0061-e8eb-4e18-834d-58e26cd90e50 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1554 microversion: 2.1 time: 0.161211 Sep 01 05:35:28.165502 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d0a95bd7-8a6a-4e98-b8f1-e97fb33ff1a7 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1554 microversion: 2.1 time: 0.166637 Sep 01 05:35:28.165907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 384/793] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:28 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:28.166058 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 409/793] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:27 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:28.170274 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.171123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.176806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.177277 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.177880 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.180896 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.180896 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.180896 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.188401 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.188937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.194866 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.195345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.195777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.196458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.196908 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.197339 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.274230 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-37fa6812-b10d-4ee1-ba5b-ed412e78cd80 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090095 Sep 01 05:35:28.274935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 385/794] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 05:35:28 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:35:28.279791 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:28.281117 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:28.287366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.287917 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.289975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.289975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:28.289975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:28.289975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:28.308834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:28.311807 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.321109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f2efed44-cf28-4af7-937c-80a0e97f819c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.154198 Sep 01 05:35:28.321922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 410/795] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:28 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:28.551190 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.559154 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.560596 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:28.562522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-879e4a3b-72b6-45a4-a1ec-a467a04cdc26 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.286190 Sep 01 05:35:28.563093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 386/796] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:28 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:29.192313 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:29.192847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:29.199464 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.199925 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.200358 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.201046 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.201502 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.201917 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.331703 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:29.340799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0616742e-bc6e-43cc-9dbb-1de3c95d9cfe tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1554 microversion: 2.1 time: 0.152333 Sep 01 05:35:29.341770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 411/797] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:29 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:29.348859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:29.357321 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:29.370474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.370964 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.371396 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.372099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.372550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.372969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.378246 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-450718f8-b20b-471c-bf81-3e7ca046b507 req-b1d0350b-480c-439d-9e87-155007f5f5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12eed38-21c3-4708-bcb4-9901084f5749", "tag": "06a7f01a-720b-4986-a3d4-62ab8bc5e8ec"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:29.389434 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-450718f8-b20b-471c-bf81-3e7ca046b507 req-b1d0350b-480c-439d-9e87-155007f5f5af service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.390028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-450718f8-b20b-471c-bf81-3e7ca046b507 req-b1d0350b-480c-439d-9e87-155007f5f5af service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.390582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-450718f8-b20b-471c-bf81-3e7ca046b507 req-b1d0350b-480c-439d-9e87-155007f5f5af service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.402025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-450718f8-b20b-471c-bf81-3e7ca046b507 req-b1d0350b-480c-439d-9e87-155007f5f5af service nova] Creating event network-changed:06a7f01a-720b-4986-a3d4-62ab8bc5e8ec for instance b12eed38-21c3-4708-bcb4-9901084f5749 on hv-cinder-83602 Sep 01 05:35:29.407527 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-450718f8-b20b-471c-bf81-3e7ca046b507 req-b1d0350b-480c-439d-9e87-155007f5f5af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036991 Sep 01 05:35:29.409116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 412/798] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:29.563616 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:29.571180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-397a5afa-2ed3-4ebf-9e36-b47031b23ed8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.232268 Sep 01 05:35:29.571960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 387/799] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:29 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:29.587063 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:29.587903 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:29.594556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.595025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.595454 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.596127 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:29.596566 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:29.596977 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:29.833774 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:29.846324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:29.848067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:29.849250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ea73032f-43f6-442a-b1d0-b067b956bee9 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.266591 Sep 01 05:35:29.863569 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 413/800] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:29 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:30.362858 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:30.364195 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:30.370667 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.371392 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.371826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.372516 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.372954 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.373586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.572589 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:30.583125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-19692e28-5bfc-47af-94a0-b63be75194b5 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1554 microversion: 2.1 time: 0.224466 Sep 01 05:35:30.583767 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 388/801] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:30 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1554 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:30.591758 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:30.593035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:30.599953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.600514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.600939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.601652 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.602090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.602536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.736333 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:30.744052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a6dd7560-1f33-4db9-8c9c-1754a2d3eec6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.156158 Sep 01 05:35:30.744618 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 414/802] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:30 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:35:30.871971 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:30.872568 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:30.879079 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.879555 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.879979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:30.880651 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:30.881093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:30.881507 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.010668 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.019318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.020764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.021910 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cd2be49e-56dc-4b3f-a91b-7f6e499b2195 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1745 microversion: 2.20 time: 0.153920 Sep 01 05:35:31.022492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 389/803] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:30 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:31.423999 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-fd9c6fab-09a0-4db3-9888-cd399d8e8971 req-e4aa4a7b-3af4-4c95-9c20-3678225fd71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e5b578-ab03-48a7-9272-9432987ef817", "name": "network-vif-deleted", "tag": "bd7c102d-defb-4763-8b8b-49ff53fc8472"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:31.433260 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-fd9c6fab-09a0-4db3-9888-cd399d8e8971 req-e4aa4a7b-3af4-4c95-9c20-3678225fd71c service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.433723 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-fd9c6fab-09a0-4db3-9888-cd399d8e8971 req-e4aa4a7b-3af4-4c95-9c20-3678225fd71c service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.434149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-fd9c6fab-09a0-4db3-9888-cd399d8e8971 req-e4aa4a7b-3af4-4c95-9c20-3678225fd71c service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.445726 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-fd9c6fab-09a0-4db3-9888-cd399d8e8971 req-e4aa4a7b-3af4-4c95-9c20-3678225fd71c service nova] Creating event network-vif-deleted:bd7c102d-defb-4763-8b8b-49ff53fc8472 for instance f5e5b578-ab03-48a7-9272-9432987ef817 on hv-cinder-83602 Sep 01 05:35:31.450521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-fd9c6fab-09a0-4db3-9888-cd399d8e8971 req-e4aa4a7b-3af4-4c95-9c20-3678225fd71c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030683 Sep 01 05:35:31.451109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 415/804] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:31.606584 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:31.607205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:31.614303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.614810 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.615244 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.615924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.616447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.616871 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.683819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9d9a240b824236aa40a3d03922b51d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '924b0db81eb1479e9bea0f8a60d66526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.691928 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-80cdd126-d685-4677-a1fc-0cbee977027e tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 200 len: 1342 microversion: 2.1 time: 0.089395 Sep 01 05:35:31.692492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 390/805] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:31 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 1342 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:31.767519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:31.768218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:31.774302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.774810 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.775276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.775957 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:31.776403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:31.776818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:31.911664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:31.919318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d938e594-7d43-4340-b94a-47ec424a9ba8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.156758 Sep 01 05:35:31.919875 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 416/806] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:31 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:32.053048 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:32.053642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:32.055457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:32.060141 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.060611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.061035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.061958 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.062425 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.069019 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.192366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:32.201132 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:32.203186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:32.208474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ed9014f8-f2f7-4699-b8df-65bba3b01d49 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1745 microversion: 2.20 time: 0.155321 Sep 01 05:35:32.208474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 391/807] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:32 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:32.713814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:32.714440 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] [instance: f5e5b578-ab03-48a7-9272-9432987ef817] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:32.720760 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.721230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.721654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.722330 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.722797 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.723206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.894043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] HTTP exception thrown: Instance f5e5b578-ab03-48a7-9272-9432987ef817 could not be found. Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Request method failure captured: Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 HTTP/1.1 Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEP3QRyIz7Z55jGwBYcbX4zKAZwF7iDx-32wB9JPtybha4qvLWknnmw8iUaZPEC0eE_-TtCQCB7jhUxIxzXbHRTdxBALgZaeSpsp3BJbh1oCgaUzX9ppKHUoLbefnwGizbqQFYnwxKh5HKOLzY7pkpAO3KReZmJBew4AbI0N57-Gofo Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 924b0db81eb1479e9bea0f8a60d66526 Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestMinimumBasicScenario-1484952582 Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:35:32.895622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/924b0db81eb1479e9bea0f8a60d66526"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/924b0db81eb1479e9bea0f8a60d66526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_924b0db81eb1479e9bea0f8a60d66526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/924b0db81eb1479e9bea0f8a60d66526"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestMinimumBasicScenario-1484952582 Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 924b0db81eb1479e9bea0f8a60d66526 Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1484952582 Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-TestMinimumBasicScenario-1484952582-project Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 4e9d9a240b824236aa40a3d03922b51d Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestMinimumBasicScenario-1484952582-project Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance f5e5b578-ab03-48a7-9272-9432987ef817 could not be found. Sep 01 05:35:32.897071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'f5e5b578-ab03-48a7-9272-9432987ef817'} Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e5b578-ab03-48a7-9272-9432987ef817 could not be found. Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:35:32.898331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e5b578-ab03-48a7-9272-9432987ef817 could not be found. Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e5b578-ab03-48a7-9272-9432987ef817 could not be found. Sep 01 05:35:32.899885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:35:32.901368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Returning 404 to user: Instance f5e5b578-ab03-48a7-9272-9432987ef817 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:35:32.901368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-24afacce-4589-40d1-8c85-082627e1e621 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817" status: 404 len: 111 microversion: 2.1 time: 0.187294 Sep 01 05:35:32.901368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 417/808] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:32 2022] GET /compute/v2.1/servers/f5e5b578-ab03-48a7-9272-9432987ef817 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:32.905823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-28160405-c4b4-479b-be8e-60b5d737d132 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] Calling method '.version_select at 0x7f953b0bde50>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:32.910399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=20 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:32.940475 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:32.941099 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:32.947102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.947579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.948000 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:32.948673 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:32.949110 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:32.949712 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.028162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-28160405-c4b4-479b-be8e-60b5d737d132 tempest-TestMinimumBasicScenario-1484952582 tempest-TestMinimumBasicScenario-1484952582-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-844308784" status: 202 len: 0 microversion: 2.1 time: 0.126003 Sep 01 05:35:33.028990 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 392/809] 10.222.0.16 () {58 vars in 1269 bytes} [Thu Sep 1 05:35:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-844308784 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:35:33.086380 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.097453 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-149d1af7-de28-4aca-a3e4-abbe282c2a05 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.161269 Sep 01 05:35:33.098270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 418/810] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:32 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:33.227786 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:33.228389 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:33.236531 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.241676 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.241676 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.241676 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:33.241676 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:33.242209 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:33.399379 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.406013 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.407618 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:33.408777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3b730281-19cc-4143-bea3-9c0edd2662f5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1745 microversion: 2.20 time: 0.184870 Sep 01 05:35:33.409346 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 393/811] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:33 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:34.120652 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:34.122494 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:34.133590 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.134436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.135276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.136230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.137353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.138617 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.291607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.306823 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-55baf803-c5e1-4379-be95-bebb246750be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.191479 Sep 01 05:35:34.319138 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 419/812] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:34 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:34.433526 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:34.434875 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:34.442654 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.443352 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.443983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.444864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:34.445560 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:34.446046 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:34.608384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.623985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.625684 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:34.627070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3d51863d-2564-4dad-9e66-940764d72a64 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.197511 Sep 01 05:35:34.643968 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 394/813] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:34 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:35.176669 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-ff3c3be8-9f6d-4243-9a74-9aeb179adc1a req-89832fb3-5240-4646-8d39-2474c7943af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f30586-8ff8-4c6a-844d-dd76b18c6656", "name": "network-vif-plugged", "status": "completed", "tag": "109dec1a-0199-46f8-abd0-b6c564581a6b"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:35.196106 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ff3c3be8-9f6d-4243-9a74-9aeb179adc1a req-89832fb3-5240-4646-8d39-2474c7943af2 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.200233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ff3c3be8-9f6d-4243-9a74-9aeb179adc1a req-89832fb3-5240-4646-8d39-2474c7943af2 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.205302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ff3c3be8-9f6d-4243-9a74-9aeb179adc1a req-89832fb3-5240-4646-8d39-2474c7943af2 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.222949 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-ff3c3be8-9f6d-4243-9a74-9aeb179adc1a req-89832fb3-5240-4646-8d39-2474c7943af2 service nova] Creating event network-vif-plugged:109dec1a-0199-46f8-abd0-b6c564581a6b for instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 on hv-cinder-83602 Sep 01 05:35:35.228702 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-ff3c3be8-9f6d-4243-9a74-9aeb179adc1a req-89832fb3-5240-4646-8d39-2474c7943af2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057612 Sep 01 05:35:35.240581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 420/814] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:35.329681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:35.330259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:35.337961 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.339440 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.339440 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.340961 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.341417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.342239 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.592533 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:35.624326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-adf159b8-3d33-49ad-a839-8003f823dd7a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.298219 Sep 01 05:35:35.625243 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 395/815] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:35 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:35.671868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:35.672462 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:35.692090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.696865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.697535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:35.698475 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:35.699075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:35.699673 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:36.006796 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:36.020865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:36.022758 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:36.024226 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bb7745d5-b769-469d-a4e9-5c9fbc2c7b31 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.372284 Sep 01 05:35:36.025999 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 421/816] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:35 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:36.646206 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:36.647540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:36.688222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:36.689838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:36.690546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:36.691762 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:36.692445 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:36.699399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:36.977852 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:36.984772 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ca4d2144-d6b8-4c24-a5f1-b6334d106d0a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1363 microversion: 2.1 time: 0.343463 Sep 01 05:35:37.002366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 396/817] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:36 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:37.052505 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:37.053912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:37.065278 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:37.065837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:37.066505 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:37.067456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:37.067928 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:37.068646 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:37.225331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:37.235481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:37.238091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:37.243063 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-023375a4-fa09-44fe-b258-c0a2d470922e req-3fa8fd6a-d916-40d0-b9be-124d7425aaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e750cb-b7bf-46f8-945d-51866ebb4c2e", "name": "network-vif-plugged", "status": "completed", "tag": "cecbb19c-0368-43b2-a813-da4b7b5869a1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:37.246881 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f30aa0f2-b25a-4f04-a714-a3f806695e75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.198311 Sep 01 05:35:37.258489 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 422/818] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:37 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:37.259518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-023375a4-fa09-44fe-b258-c0a2d470922e req-3fa8fd6a-d916-40d0-b9be-124d7425aaa9 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:37.259518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-023375a4-fa09-44fe-b258-c0a2d470922e req-3fa8fd6a-d916-40d0-b9be-124d7425aaa9 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:37.259518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-023375a4-fa09-44fe-b258-c0a2d470922e req-3fa8fd6a-d916-40d0-b9be-124d7425aaa9 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:37.267289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-023375a4-fa09-44fe-b258-c0a2d470922e req-3fa8fd6a-d916-40d0-b9be-124d7425aaa9 service nova] Creating event network-vif-plugged:cecbb19c-0368-43b2-a813-da4b7b5869a1 for instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e on hv-cinder-83602 Sep 01 05:35:37.272130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-023375a4-fa09-44fe-b258-c0a2d470922e req-3fa8fd6a-d916-40d0-b9be-124d7425aaa9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032712 Sep 01 05:35:37.272820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 397/819] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:35:38.008846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:38.009376 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:38.018104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.018653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.019094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.019812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.020263 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.020713 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.274155 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:38.275810 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:38.288375 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.289232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.289880 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.290819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.291596 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.292234 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.421678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.430511 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-62b10a2f-a0cc-4a82-a5a8-4bd220fa0571 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1549 microversion: 2.1 time: 0.425599 Sep 01 05:35:38.431720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 423/820] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:35:38 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1549 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:35:38.455113 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:38.456813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:38.465809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.467456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.468043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.468890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:38.469586 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:38.470176 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:38.481290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=100 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:38.505924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.514942 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.516391 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:38.518694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1a70f967-c74c-4c1a-bfcb-96c97c78f98c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.248936 Sep 01 05:35:38.519900 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 398/821] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:38 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:38.653433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-51568e9f-0b45-42a8-9fb7-dc4d1903687b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203795 Sep 01 05:35:38.661683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 424/822] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 05:35:38 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:39.550672 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:39.551289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:39.558451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:39.559285 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:39.559935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:39.564555 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:39.566135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:39.566798 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:39.753870 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:39.762746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:39.765048 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:39.766454 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9afb8d35-4c02-4539-b954-022274dc4b16 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.223768 Sep 01 05:35:39.767223 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 399/823] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:39 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 05:35:40.401552 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-c49fd6b7-dc2e-4afb-9370-6098c5d0edc6 req-438e9904-311f-469b-901e-cd9ba0b4231c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52f30586-8ff8-4c6a-844d-dd76b18c6656", "tag": "109dec1a-0199-46f8-abd0-b6c564581a6b"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:40.412225 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c49fd6b7-dc2e-4afb-9370-6098c5d0edc6 req-438e9904-311f-469b-901e-cd9ba0b4231c service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:40.415828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c49fd6b7-dc2e-4afb-9370-6098c5d0edc6 req-438e9904-311f-469b-901e-cd9ba0b4231c service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:40.415828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c49fd6b7-dc2e-4afb-9370-6098c5d0edc6 req-438e9904-311f-469b-901e-cd9ba0b4231c service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:40.426042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-c49fd6b7-dc2e-4afb-9370-6098c5d0edc6 req-438e9904-311f-469b-901e-cd9ba0b4231c service nova] Creating event network-changed:109dec1a-0199-46f8-abd0-b6c564581a6b for instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 on hv-cinder-83602 Sep 01 05:35:40.431651 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-c49fd6b7-dc2e-4afb-9370-6098c5d0edc6 req-438e9904-311f-469b-901e-cd9ba0b4231c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033783 Sep 01 05:35:40.433043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 425/824] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:35:40.789301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:40.790839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:40.804064 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:40.804819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:40.805473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:40.809368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:40.810137 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:40.811443 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:41.056222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:41.067121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:41.075739 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:41.077367 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-60f01781-66f2-478f-9f32-2586b27b55b5 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.291894 Sep 01 05:35:41.083122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 400/825] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:40 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:42.104172 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:42.104905 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:42.112277 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:42.112752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:42.113178 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:42.113913 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:42.114357 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:42.114793 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:42.270135 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:42.279303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:42.281562 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:42.283330 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-59a72dc8-23c9-47ac-8c24-e854a8e8fd59 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.186096 Sep 01 05:35:42.299156 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 426/826] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:42 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:43.314672 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:43.316644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:43.327991 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.338623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.338623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.338623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:43.338623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:43.339250 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:43.509423 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.518833 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.524184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:43.527939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f7c072d4-c3f9-4008-92c2-639770d7dbd7 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.217561 Sep 01 05:35:43.527939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 401/827] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:43 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:44.548269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:44.549459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:44.557508 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.559730 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.561989 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.562887 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:44.563687 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:44.564401 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:44.722845 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:44.732937 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:44.735532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:44.737694 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6b7e377f-25fe-44cb-9815-05fd9c26141a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.192787 Sep 01 05:35:44.747791 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 427/828] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:44 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:45.760951 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:45.761626 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:45.768740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.769294 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.769794 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.770614 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:45.771540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:45.771971 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:45.905396 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.913419 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.914892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:45.916031 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-25bfa9d8-a11e-4755-9c43-61bea0772da6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.159485 Sep 01 05:35:45.916587 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 402/829] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:45 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:46.940047 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:46.940611 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:46.946898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.947368 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.947790 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:46.948456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:46.948893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:46.949329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:47.089049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:47.098303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:47.099840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:47.101146 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-67de3ca6-7cdc-4258-933e-684f82b11e45 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1740 microversion: 2.20 time: 0.166020 Sep 01 05:35:47.101709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 428/830] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:46 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:48.125533 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:48.126155 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:48.132674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:48.133156 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:48.133611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.134296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:48.134768 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:48.135214 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:48.334978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.343111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.344557 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:48.345692 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e307edfc-c61a-4387-aa32-0932212b07ed tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1722 microversion: 2.20 time: 0.224681 Sep 01 05:35:48.346259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 403/831] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:48 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:49.369527 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:49.370127 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:49.376665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:49.377136 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:49.377559 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:49.378433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:49.378915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:49.379334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:49.508354 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:49.517062 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:49.518521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:49.519665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-60884c70-b77d-4ab4-ae8f-7149fd70b9fe tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1722 microversion: 2.20 time: 0.154072 Sep 01 05:35:49.520224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 429/832] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:49 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:50.541937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:50.542587 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:50.549326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:50.549801 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:50.550231 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.550931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:50.551379 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:50.551795 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:50.680610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:50.684038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:50.694306 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:50.694306 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:50.694306 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b7821880-d939-40d7-8100-404ff48132a8 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1722 microversion: 2.20 time: 0.153542 Sep 01 05:35:50.694787 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 404/833] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:50 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:51.718390 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:51.719008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:51.721394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=78 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:51.726095 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.732519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.732519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.732519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.732519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.732908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.858838 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:51.866767 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:51.868203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:51.869340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4519e5c7-0846-4dbe-9877-fb0869f5e281 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1665 microversion: 2.20 time: 0.155394 Sep 01 05:35:51.869905 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 430/834] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:51 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:51.891222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0b94b8e-21bd-43ff-ae0b-598f3d7f2862"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:51.893485 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:51.900122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.900599 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.901026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:51.901691 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:51.902131 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:51.902568 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:52.811811 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-84d1c746-d7dc-4ae2-9321-9b27d22fbe0f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.924528 Sep 01 05:35:52.812415 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 405/835] 10.222.0.16 () {62 vars in 1364 bytes} [Thu Sep 1 05:35:51 2022] POST /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/os-volume_attachments => generated 188 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 05:35:52.931729 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:52.932230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:52.938897 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:52.939375 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:52.939814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:52.940495 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:52.940953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:52.941376 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.141099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-4abd9ca3-c5db-4e1b-8123-f0bf25eb2c83 req-69c84ea9-ca7c-4762-93e2-7cf40e22f785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e750cb-b7bf-46f8-945d-51866ebb4c2e", "name": "network-vif-unplugged", "status": "completed", "tag": "cecbb19c-0368-43b2-a813-da4b7b5869a1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:53.152194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-4abd9ca3-c5db-4e1b-8123-f0bf25eb2c83 req-69c84ea9-ca7c-4762-93e2-7cf40e22f785 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.152610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-4abd9ca3-c5db-4e1b-8123-f0bf25eb2c83 req-69c84ea9-ca7c-4762-93e2-7cf40e22f785 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.153029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-4abd9ca3-c5db-4e1b-8123-f0bf25eb2c83 req-69c84ea9-ca7c-4762-93e2-7cf40e22f785 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.163695 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.compute.server_external_events [req-4abd9ca3-c5db-4e1b-8123-f0bf25eb2c83 req-69c84ea9-ca7c-4762-93e2-7cf40e22f785 service nova] Unable to find a host for instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e. Dropping event network-vif-unplugged {{(pid=121030) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:35:53.164551 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-4abd9ca3-c5db-4e1b-8123-f0bf25eb2c83 req-69c84ea9-ca7c-4762-93e2-7cf40e22f785 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027913 Sep 01 05:35:53.165107 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 406/836] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 01 05:35:53.542667 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-11cb2765-a70a-4d5e-bfa6-203b11f01372 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/os-volume_attachments/a0b94b8e-21bd-43ff-ae0b-598f3d7f2862" status: 202 len: 0 microversion: 2.20 time: 0.614797 Sep 01 05:35:53.543263 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 431/837] 10.222.0.16 () {60 vars in 1457 bytes} [Thu Sep 1 05:35:52 2022] DELETE /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/os-volume_attachments/a0b94b8e-21bd-43ff-ae0b-598f3d7f2862 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:35:53.603437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:35:53.604028 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:53.610927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.611408 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.611839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.612561 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.613070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.613489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.655835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121030) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:35:53.942543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f2ce9bd0-bbae-45fc-a793-6f078b181c5e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "POST /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/action" status: 202 len: 0 microversion: 2.20 time: 0.342945 Sep 01 05:35:53.943169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 407/838] 10.222.0.16 () {62 vars in 1319 bytes} [Thu Sep 1 05:35:53 2022] POST /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:35:53.951359 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:53.952235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:53.959093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.959568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.959997 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:53.960677 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:53.961128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:53.961543 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:54.092597 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:54.100667 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:54.102145 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:54.103315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4e647d32-d910-4c02-a5c8-7df949d34e30 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1673 microversion: 2.20 time: 0.155916 Sep 01 05:35:54.103883 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 432/839] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:53 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:55.127614 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:55.128191 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:55.134042 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.134541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.134971 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.135644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:55.136111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:55.136507 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:55.265657 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:55.274292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:55.276061 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:55.277538 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-234d0124-826f-41cf-99ea-b1b1f98994b4 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1675 microversion: 2.20 time: 0.154339 Sep 01 05:35:55.278099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 408/840] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:55 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:56.300850 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:56.301436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:56.307763 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:56.308234 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:56.308659 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:56.309331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:56.310552 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:56.310962 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:56.454839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:56.463778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:56.465214 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:56.466442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-708b0ce2-0319-410a-9bc7-136cd7e2df93 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.169478 Sep 01 05:35:56.467286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 433/841] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:56 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:57.490770 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:57.491439 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:57.498447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:57.499168 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:57.499600 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:57.500285 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:57.500730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:57.501148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:57.649922 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:57.661782 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:57.663253 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:57.664425 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b1f02540-fc5e-493b-8e4f-00b0b097709e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.177670 Sep 01 05:35:57.665216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 409/842] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:57 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:58.688104 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:58.688863 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:58.695374 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:58.696097 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:58.696536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:58.697231 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:58.697680 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:58.698098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:58.850395 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:58.859889 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:58.861543 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:35:58.862821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7096eb1a-518f-4d0e-a599-2f54af2e0c2e tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.179323 Sep 01 05:35:58.863457 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 434/843] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:58 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:35:59.885318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:35:59.886640 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:35:59.889851 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:59.895644 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:59.896289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:59.896911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:35:59.897933 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:35:59.898555 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:35:59.899071 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:00.045369 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:00.055203 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:00.056938 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:00.058337 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f39df6d0-8399-4888-a3b1-7c9e73bfa210 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.176810 Sep 01 05:36:00.059870 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 410/844] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:35:59 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:01.082052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:01.084153 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:01.091294 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:01.091778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:01.092345 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:01.093077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:01.094724 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:01.095436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:01.238241 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:01.248567 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:01.250233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:01.251614 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f6fd3a69-e6ca-4c2d-ab33-46506f84bd99 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.173596 Sep 01 05:36:01.252184 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 435/845] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:01 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:02.276053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:02.276702 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:02.283539 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:02.284016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:02.284618 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:02.285846 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:02.286831 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:02.287254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:02.436141 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:02.444641 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:02.446088 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:02.447281 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-032eb7a2-2aaf-4b23-8d89-1436ec3caf75 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.176241 Sep 01 05:36:02.448029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 411/846] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:02 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:03.472302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:03.472919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:03.479424 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:03.479896 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:03.480317 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:03.480992 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:03.481431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:03.481834 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:03.617635 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:03.627675 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:03.629105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:03.630262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d28ea720-f8c1-4739-b446-7fedc0d51782 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.162592 Sep 01 05:36:03.631065 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 436/847] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:03 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:04.655375 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:04.656610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:04.663430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:04.668687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:04.668687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:04.668687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:04.668687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:04.669060 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:04.814057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:04.821982 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:04.823443 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:04.824564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fa5dbae7-7633-4774-9fab-0638a2b1ae1d tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.173554 Sep 01 05:36:04.825118 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 412/848] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:04 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:05.848415 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:05.849020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:05.855526 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:05.855996 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:05.856422 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:05.857099 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:05.857545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:05.857965 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:05.986242 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:05.994261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:05.995735 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:05.996886 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-617b33bf-1c81-492f-8728-b246a0f5121b tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.152398 Sep 01 05:36:05.997448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 437/849] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:05 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:07.020659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:07.021259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:07.027707 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:07.028184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:07.028616 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:07.029295 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:07.029744 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:07.030161 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:07.164768 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:07.173767 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:07.175236 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:07.176385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2cfe79a9-7986-49ea-aad0-6ad4a9519927 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.159700 Sep 01 05:36:07.176954 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 413/850] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:07 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:07.423275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:07.423859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:07.429712 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:07.430186 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:07.430642 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:07.431327 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:07.431771 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:07.432188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:07.455466 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-91ddaf7f-3030-4096-98f6-b4d82099429f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/ips" status: 200 len: 149 microversion: 2.1 time: 0.036701 Sep 01 05:36:07.456024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 438/851] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:36:07 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:08.200056 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:08.201342 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:08.207714 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:08.208183 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:08.208610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:08.209336 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:08.209774 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:08.210188 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:08.341447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:08.349798 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:08.351537 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:08.352440 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-277ef2bf-b7df-4e1d-abfb-b5d8602ce661 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.156382 Sep 01 05:36:08.353090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 414/852] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:08 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:09.376128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:09.376738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:09.383316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:09.388506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:09.388506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:09.388506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:09.388506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:09.389019 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:09.389676 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:09.517949 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:09.525829 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:09.527307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:09.528453 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-38ec6248-fe94-4182-8bf3-c12fdd020865 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.157030 Sep 01 05:36:09.529015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 439/853] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:09 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:09.770509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7894df7-ba71-4561-b718-7dbf777300a8"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:09.772964 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:09.780069 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:09.780552 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:09.780984 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:09.781679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:09.782131 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:09.782583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:10.508002 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-dc447623-c0a7-4dbf-9703-a67d58c65c8b tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "POST /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741313 Sep 01 05:36:10.508656 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 415/854] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:36:09 2022] POST /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:10.551030 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:10.551639 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:10.563355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:10.565492 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:10.565492 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:10.565492 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:10.565492 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:10.565881 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:10.699734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:10.708489 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:10.710052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:10.711319 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-58653832-6abf-453f-81c6-424ce0f428d3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.164366 Sep 01 05:36:10.711952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 440/855] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:10 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:11.324478 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-fd9d229e-1e67-4732-a36c-40580f453833 req-94b08cd5-a043-4767-a3ef-6640d555f7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e750cb-b7bf-46f8-945d-51866ebb4c2e", "name": "network-vif-plugged", "status": "completed", "tag": "cecbb19c-0368-43b2-a813-da4b7b5869a1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:11.334066 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-fd9d229e-1e67-4732-a36c-40580f453833 req-94b08cd5-a043-4767-a3ef-6640d555f7a4 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:11.334552 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-fd9d229e-1e67-4732-a36c-40580f453833 req-94b08cd5-a043-4767-a3ef-6640d555f7a4 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:11.334963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-fd9d229e-1e67-4732-a36c-40580f453833 req-94b08cd5-a043-4767-a3ef-6640d555f7a4 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:11.348122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-fd9d229e-1e67-4732-a36c-40580f453833 req-94b08cd5-a043-4767-a3ef-6640d555f7a4 service nova] Creating event network-vif-plugged:cecbb19c-0368-43b2-a813-da4b7b5869a1 for instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e on hv-cinder-83602 Sep 01 05:36:11.352810 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-fd9d229e-1e67-4732-a36c-40580f453833 req-94b08cd5-a043-4767-a3ef-6640d555f7a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 Sep 01 05:36:11.353399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 416/856] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:11.734388 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:11.735017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:11.741394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:11.741837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:11.742259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:11.742988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:11.743429 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:11.743843 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:11.872716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:11.881093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:11.882603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:11.883759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7407c9b2-e1ea-4ee8-ab43-f79ae95148a3 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.153352 Sep 01 05:36:11.884351 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 441/857] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:11 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:12.908296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:12.908986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:12.915157 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:12.915636 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:12.916066 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:12.916752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:12.917202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:12.917623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:13.047357 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:13.050950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:13.056189 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:13.058709 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:13.058839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-95058211-e29f-490a-9f67-dc6efbbce4e0 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.155709 Sep 01 05:36:13.059857 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 417/858] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:12 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:14.081759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:14.082493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:14.089068 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:14.089541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:14.090037 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:14.090749 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:14.091197 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:14.092201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:14.222542 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:14.230578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:14.232011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:14.233144 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2304c6e3-f523-404c-a290-1edf395aabca tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1731 microversion: 2.20 time: 0.155464 Sep 01 05:36:14.233695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 442/859] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:14 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:15.256184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:15.256813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:15.264657 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:15.265130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:15.265560 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:15.266239 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:15.266717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:15.267139 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:15.394620 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:15.402584 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:15.404656 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:15.405806 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9aa967da-ec9e-4a32-92b2-5e15f15630d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1718 microversion: 2.20 time: 0.153670 Sep 01 05:36:15.406368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 418/860] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:15 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:16.890425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:16.890943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:16.897093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:16.897568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:16.897995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:16.898704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:16.899150 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:16.899561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:16.922907 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-3aa7a59b-aec1-4c53-b9cc-cf25c3b4fdbb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/ips" status: 200 len: 144 microversion: 2.1 time: 0.036363 Sep 01 05:36:16.923469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 443/861] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:36:16 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:36:18.116927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:18.117419 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:18.124598 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.125076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.125511 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.126198 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.126676 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.127102 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.206921 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lazy-loading 'services' on Instance uuid b12eed38-21c3-4708-bcb4-9901084f5749 {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:36:18.388024 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cf6f0ded-fae4-479f-8466-82127fec676e tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-volume_attachments/c7894df7-ba71-4561-b718-7dbf777300a8" status: 202 len: 0 microversion: 2.1 time: 0.274811 Sep 01 05:36:18.388681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 419/862] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:36:18 2022] DELETE /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-volume_attachments/c7894df7-ba71-4561-b718-7dbf777300a8 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:36:18.396960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:18.399265 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:18.406319 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.406828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.407256 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.407943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:18.408390 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:18.408806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:18.441516 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-96c7dc32-3c9d-48e2-a3e7-6fe961c4ec38 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048434 Sep 01 05:36:18.441996 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 444/863] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:36:18 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:19.455502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:19.457863 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:19.464109 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.464589 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.465024 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.465707 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.466159 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.466659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.495532 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0d9b4f5e-21ef-41ff-bfb8-085fb6f7343d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045540 Sep 01 05:36:19.496091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 420/864] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:36:19 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 05:36:19.557577 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:19.558095 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:19.565234 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.565734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.566165 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.566878 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.567324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.567741 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.593840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:36:19.863566 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-08e2e25e-c0e7-46c3-838c-999f5814958c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 204 len: 0 microversion: 2.1 time: 0.309599 Sep 01 05:36:19.864071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 445/865] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:36:19 2022] DELETE /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:36:19.872384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:19.872969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:19.879030 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.879495 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.879919 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:19.880587 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:19.881026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:19.881435 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.022174 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:20.030474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-74b8cd75-7e6c-4733-b259-46da8fd77907 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1678 microversion: 2.1 time: 0.161379 Sep 01 05:36:20.031050 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 421/866] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:19 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:20.183661 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd6a1168-0636-44b8-ab72-2f1fa181ae9d"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:20.186934 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:20.192800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:20.193280 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:20.193716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:20.194426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:20.194875 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:20.195302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.051992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:21.052710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:21.059493 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:21.059966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:21.060392 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.061074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:21.061514 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:21.061931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:21.189111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:21.196812 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5a5da303-c439-4c1d-8d8d-40778e2fa4fe tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1678 microversion: 2.1 time: 0.148705 Sep 01 05:36:21.197384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 422/867] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:21 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:21.918902 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f49f6768-9d9a-434d-b472-34ea2ce57c29 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.739463 Sep 01 05:36:21.924759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 446/868] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:36:20 2022] POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/os-volume_attachments => generated 194 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:22.218283 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:22.219086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:22.225690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.226237 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.226756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:22.227450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.227951 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.228418 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:22.313447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:22.321360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-401b9c8e-4a1b-4438-b8a1-a50a957f392c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1611 microversion: 2.1 time: 0.107536 Sep 01 05:36:22.321962 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 423/869] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:22 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1611 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:22.426434 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-153dc992-58a7-4b68-b686-c58aa6cb76b6 req-8cb9fe93-5f27-42cc-a93e-8b60be27bf1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12eed38-21c3-4708-bcb4-9901084f5749", "name": "network-vif-deleted", "tag": "06a7f01a-720b-4986-a3d4-62ab8bc5e8ec"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:22.431538 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:22.437159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-153dc992-58a7-4b68-b686-c58aa6cb76b6 req-8cb9fe93-5f27-42cc-a93e-8b60be27bf1a service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:22.437631 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-153dc992-58a7-4b68-b686-c58aa6cb76b6 req-8cb9fe93-5f27-42cc-a93e-8b60be27bf1a service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:22.438054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-153dc992-58a7-4b68-b686-c58aa6cb76b6 req-8cb9fe93-5f27-42cc-a93e-8b60be27bf1a service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:22.449630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-153dc992-58a7-4b68-b686-c58aa6cb76b6 req-8cb9fe93-5f27-42cc-a93e-8b60be27bf1a service nova] Creating event network-vif-deleted:06a7f01a-720b-4986-a3d4-62ab8bc5e8ec for instance b12eed38-21c3-4708-bcb4-9901084f5749 on hv-cinder-83602 Sep 01 05:36:22.457898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-153dc992-58a7-4b68-b686-c58aa6cb76b6 req-8cb9fe93-5f27-42cc-a93e-8b60be27bf1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036154 Sep 01 05:36:22.459174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 447/870] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:23.342899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:23.343518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:23.350188 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:23.354783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:23.354783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:23.354783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:23.354783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:23.355345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:23.385804 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:23.386274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:23.386732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:23.387171 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lazy-loading 'fault' on Instance uuid b12eed38-21c3-4708-bcb4-9901084f5749 {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:36:23.426918 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11770fbaeacd4fc7bc4052e83630dbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a200065c13e42babe6353689aabd896', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:23.434798 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2bd10d81-c16d-4d57-a4ed-1e6884f4fe9c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 200 len: 1329 microversion: 2.1 time: 0.095744 Sep 01 05:36:23.435362 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 424/871] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:23 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 1329 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:24.457759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:24.458360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:24.465147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:24.465611 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:24.466030 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:24.466728 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:24.467169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:24.467579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:24.481479 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 HTTP/1.1 Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:24.483117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:24.484782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'b12eed38-21c3-4708-bcb4-9901084f5749'} Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:24.485745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:24.487196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:24.488352 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:24.488352 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8d994b09-85f2-4b55-9f5f-f3ee8f3c46dc tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 404 len: 111 microversion: 2.1 time: 0.032201 Sep 01 05:36:24.488352 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 448/872] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:24 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:24.493473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-734431a4-cb7c-47f5-b823-dd00afb65c8f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '.version_select at 0x7f953af060d0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:24.582826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-734431a4-cb7c-47f5-b823-dd00afb65c8f tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63666867" status: 202 len: 0 microversion: 2.1 time: 0.093167 Sep 01 05:36:24.583387 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 425/873] 10.222.0.16 () {58 vars in 1215 bytes} [Thu Sep 1 05:36:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63666867 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:36:26.580878 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:26.581392 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:26.588380 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.588860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.589286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.589963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.590432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.590843 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.605377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 HTTP/1.1 Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:26.607094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.608688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'b12eed38-21c3-4708-bcb4-9901084f5749'} Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:26.610777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.612211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.613605 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:26.613605 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2813104a-9edd-441c-a399-d921bfb576cd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 404 len: 111 microversion: 2.1 time: 0.031534 Sep 01 05:36:26.613605 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 449/874] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:36:26 2022] DELETE /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:26.618257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:26.624042 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: b12eed38-21c3-4708-bcb4-9901084f5749] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:26.626083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.626602 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.627035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.627712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:26.628159 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:26.628576 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:26.641966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 HTTP/1.1 Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:36:26.643671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.645292 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': 'b12eed38-21c3-4708-bcb4-9901084f5749'} Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:26.652836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. Sep 01 05:36:26.655025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:26.656588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance b12eed38-21c3-4708-bcb4-9901084f5749 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:26.656588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-74af5ce9-a109-488f-9f18-ce08c8bc0d37 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749" status: 404 len: 111 microversion: 2.1 time: 0.031392 Sep 01 05:36:26.656588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 426/875] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:26 2022] GET /compute/v2.1/servers/b12eed38-21c3-4708-bcb4-9901084f5749 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:27.967868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:27.968381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:27.974624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:27.975101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:27.975526 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:27.976203 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:27.976650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:27.977069 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:27.990751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a HTTP/1.1 Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:27.992271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:27.993862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'a7840364-745b-43e2-988f-ad0069efa14a'} Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:27.994759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:27.996205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:27.997752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:27.997752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b8fd1d98-eda2-4158-9e0c-851283a58ce1 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 404 len: 111 microversion: 2.1 time: 0.029579 Sep 01 05:36:27.997752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 450/876] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:36:27 2022] DELETE /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:28.002380 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:28.003011 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: a7840364-745b-43e2-988f-ad0069efa14a] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:28.009317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.009796 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.010233 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.010934 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.011384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.011805 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.024662 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a HTTP/1.1 Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:36:28.026129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:28.027661 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': 'a7840364-745b-43e2-988f-ad0069efa14a'} Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:28.028586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. Sep 01 05:36:28.030026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.031438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance a7840364-745b-43e2-988f-ad0069efa14a could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:28.031438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9bc42977-0870-4e6e-905a-ea659487e10d tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a" status: 404 len: 111 microversion: 2.1 time: 0.029602 Sep 01 05:36:28.031438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 427/877] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:27 2022] GET /compute/v2.1/servers/a7840364-745b-43e2-988f-ad0069efa14a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:28.035754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:28.036239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:28.042059 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.042553 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.042973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.043637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.044072 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.044482 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.058023 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e HTTP/1.1 Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:28.059892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.061510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '5080257c-de42-42cc-8244-50ab47c0e94e'} Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:28.063024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.064259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.065524 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:28.065524 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6ed91623-74ed-4f4f-8a9c-93b5538e4220 tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 404 len: 111 microversion: 2.1 time: 0.029303 Sep 01 05:36:28.065524 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 451/878] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:36:28 2022] DELETE /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:28.070706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:28.071309 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 5080257c-de42-42cc-8244-50ab47c0e94e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:28.077168 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.077682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.078111 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.078842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:28.079274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:28.079692 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:28.092844 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e HTTP/1.1 Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:36:28.094377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.095983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '5080257c-de42-42cc-8244-50ab47c0e94e'} Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:28.096978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. Sep 01 05:36:28.098476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:28.099884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance 5080257c-de42-42cc-8244-50ab47c0e94e could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:28.099884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-94a044e7-6f78-4289-94db-0af0a4774b8c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e" status: 404 len: 111 microversion: 2.1 time: 0.028823 Sep 01 05:36:28.099884 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 428/879] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:28 2022] GET /compute/v2.1/servers/5080257c-de42-42cc-8244-50ab47c0e94e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:29.391288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:29.391785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:29.398035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.398541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.398971 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.399847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.400073 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.400485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.418170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff HTTP/1.1 Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:29.419731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.421929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '6e4956c0-5c09-4733-a34a-a06dfb38a0ff'} Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:29.422782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.424008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.425337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:29.425337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a94f3ab2-c3c5-4b3e-ad47-d4903e34e8dd tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 404 len: 111 microversion: 2.1 time: 0.033729 Sep 01 05:36:29.425337 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 452/880] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:36:29 2022] DELETE /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:29.430655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:29.431260 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] [instance: 6e4956c0-5c09-4733-a34a-a06dfb38a0ff] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:29.435147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4b9eb039-8005-468a-a39c-2c58ea3723cb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:29.437840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.438341 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.438829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.439509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.439953 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.440489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.440974 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b9eb039-8005-468a-a39c-2c58ea3723cb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.441446 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b9eb039-8005-468a-a39c-2c58ea3723cb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.441873 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b9eb039-8005-468a-a39c-2c58ea3723cb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.454393 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] HTTP exception thrown: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Request method failure captured: Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff HTTP/1.1 Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM_QzV-oP3MJS4qL8hcqe701VrDql7J1ECyoTyWe3tXt41_cQ1SPAI2IEmRva-Y9lNuztIaC-WtK6OeN4UWV1xUQM1VQm-7G_U_kRlnv3RvYpLGZ5wGs-rVqIuvgGYFTaUETwQvWvdC98NY5Ub_XoYMMAXqRthdKF62TCOyZLo7Mq4 Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:36:29.455945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a200065c13e42babe6353689aabd896"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a200065c13e42babe6353689aabd896"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a200065c13e42babe6353689aabd896"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 1a200065c13e42babe6353689aabd896 Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1506717625 Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 11770fbaeacd4fc7bc4052e83630dbb3 Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeNegativeTest-1506717625-project Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.457546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '6e4956c0-5c09-4733-a34a-a06dfb38a0ff'} Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:29.458350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. Sep 01 05:36:29.459622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:29.460752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] Returning 404 to user: Instance 6e4956c0-5c09-4733-a34a-a06dfb38a0ff could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:29.460752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7e2ba5ba-efe3-4f5c-b1ca-63f908f5003c tempest-AttachVolumeNegativeTest-1506717625 tempest-AttachVolumeNegativeTest-1506717625-project] 10.222.0.16 "GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff" status: 404 len: 111 microversion: 2.1 time: 0.030655 Sep 01 05:36:29.460752 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 429/881] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:29 2022] GET /compute/v2.1/servers/6e4956c0-5c09-4733-a34a-a06dfb38a0ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:36:29.501498 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4b9eb039-8005-468a-a39c-2c58ea3723cb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Going to try to stop instance {{(pid=121031) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:36:29.660827 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4b9eb039-8005-468a-a39c-2c58ea3723cb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/action" status: 202 len: 0 microversion: 2.1 time: 0.229487 Sep 01 05:36:29.661429 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 453/882] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:36:29 2022] POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:36:29.669503 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:29.670551 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:29.676213 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.676708 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.677124 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.677857 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:29.678303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:29.678748 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:29.889659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:29.898384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-14c3b075-80d2-49a6-af6a-132248ab294f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.232749 Sep 01 05:36:29.898975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 430/883] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:29 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:30.920814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:30.922938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:30.929616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.930311 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.930770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:30.931815 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:30.931948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:30.932335 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:31.066997 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:31.075258 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f25fa524-e9d1-4e83-85f6-65771daba286 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.159350 Sep 01 05:36:31.075814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 454/884] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:30 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:32.097451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:32.098123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:32.100638 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:32.105412 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.105887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.106366 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.107074 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:32.107520 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:32.107937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:32.238700 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:32.246932 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1b9fd29a-ef49-4f2e-b925-2f79a2536e74 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.153816 Sep 01 05:36:32.247587 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 431/885] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:32 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:33.267857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:33.268459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:33.275024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.275492 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.275921 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.279006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:33.279006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:33.279006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:33.431618 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:33.440970 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2fa1426b-5e55-404e-ae35-552884e7a9ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.176980 Sep 01 05:36:33.441550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 455/886] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:33 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:34.462552 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:34.463199 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:34.469560 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.470040 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.470503 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.471259 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:34.471678 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:34.472103 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:34.606754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:34.615286 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-889ec8a9-7629-404b-9736-68be9514888b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.156916 Sep 01 05:36:34.615966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 432/887] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:34 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:35.639288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:35.640567 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:35.647260 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.647683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.648109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.648795 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:35.649240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:35.649654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:35.653716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:35.782331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:35.790372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1187fe7a-4178-4a79-9b67-de8da3919581 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.157640 Sep 01 05:36:35.790977 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 456/888] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:35 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:36.811433 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:36.812607 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:36.819012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:36.824460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:36.824460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:36.824460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:36.824460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:36.825023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:36.962976 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:36.971693 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-bed49fa8-8eb8-45e5-a29e-7299bc7370ef tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.164448 Sep 01 05:36:36.972255 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 433/889] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:36 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:37.992788 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:37.993395 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:38.000807 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:38.001283 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:38.001710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:38.002390 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:38.002862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:38.003275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:38.135196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:38.143563 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-28276dfe-984f-46d1-bf19-f517868ca86e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.154987 Sep 01 05:36:38.144153 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 457/890] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:37 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:39.165148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:39.165755 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:39.172601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:39.173076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:39.173509 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:39.174188 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:39.174658 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:39.175077 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:39.302681 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:39.311092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-857c3865-de17-46fa-a7c4-97dbfc3931e1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.149810 Sep 01 05:36:39.311652 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 434/891] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:39 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:40.332372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:40.333001 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:40.339663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:40.340133 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:40.340557 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:40.341228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:40.341669 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:40.342081 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:40.472318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:40.479743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-79240986-dd6a-4926-8f01-3a47f358aa76 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.151981 Sep 01 05:36:40.480381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 458/892] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:40 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:41.502855 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:41.503457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:41.509682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:41.514583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:41.514583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:41.514583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:41.514583 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:41.514954 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:41.650275 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:41.659080 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a20ec42a-8565-4d7e-9a8e-49e83e6ddc32 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.160177 Sep 01 05:36:41.659634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 435/893] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:41 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:42.680327 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:42.680926 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:42.687500 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:42.687968 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:42.688656 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:42.689052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:42.689494 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:42.689906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:42.814915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:42.822954 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cda6f4fb-4a17-40fd-b520-c6d8792d656a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.146554 Sep 01 05:36:42.823513 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 459/894] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:42 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:43.844017 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:43.844614 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:43.850935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:43.851403 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:43.851824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:43.852490 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:43.852937 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:43.853352 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:43.981525 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:43.990628 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c70dacab-93e7-4638-a15c-3a451b425e88 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.150508 Sep 01 05:36:43.991200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 436/895] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:43 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:45.012494 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:45.013053 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:45.019864 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:45.020327 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:45.020756 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:45.021422 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:45.021862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:45.022272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:45.153150 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:45.161031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6dad8276-2293-4ec5-a454-68739d865460 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.152501 Sep 01 05:36:45.161593 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 460/896] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:45 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:46.182793 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:46.183393 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:46.189696 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:46.190170 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:46.190637 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:46.191318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:46.191765 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:46.192183 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:46.196029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:46.323974 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:46.333465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-91835640-75f3-4fec-a21c-8040cca9c233 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.154531 Sep 01 05:36:46.334328 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 437/897] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:46 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:47.355050 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:47.357934 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:47.362850 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.363323 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.363752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.364430 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.364872 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.365287 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.497984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:47.506789 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bccd661c-3da8-439f-a4bf-3807405d4c58 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.155724 Sep 01 05:36:47.507352 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 461/898] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:47 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:47.967559 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:47.970176 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:47.977189 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.977663 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.978090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:47.978794 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:47.979234 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:47.979645 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.009141 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6b1c83e7-b34a-4180-92ba-5ec28efcf062 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045749 Sep 01 05:36:48.009698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 438/899] 10.222.0.16 () {60 vars in 1343 bytes} [Thu Sep 1 05:36:47 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:48.071463 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:48.078049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:48.078049 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.078681 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.079106 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.079781 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.080221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.080637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.116894 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:36:48.410628 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f6b05976-e643-48b0-9f28-b0cd23b3c625 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 204 len: 0 microversion: 2.20 time: 0.342892 Sep 01 05:36:48.411326 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 462/900] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 1 05:36:48 2022] DELETE /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:36:48.419986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:48.420577 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:48.426586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.427057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.427483 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.428155 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.428601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.429041 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.528517 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:48.529481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:48.538432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.538432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.538432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.538432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:48.538839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:48.538839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:48.559825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.570013 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.572038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.573457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-521232ab-48dc-4792-88d7-e47d91347996 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.157434 Sep 01 05:36:48.574016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 439/901] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:48 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:48.682557 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:48.692422 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e66281ea-3d52-4e24-a141-096973f6fd4c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.167213 Sep 01 05:36:48.692422 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 463/902] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:48 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:36:49.598727 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:49.599625 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:49.606193 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:49.606692 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:49.607448 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:49.608172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:49.608611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:49.609022 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:49.712992 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:49.713595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:49.721001 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:49.721487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:49.721917 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:49.722768 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:49.723218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:49.723638 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:49.762602 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:49.771767 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:49.773269 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:49.774438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2bb6b4fd-b1f5-4641-9dd1-2f86ab54e1d6 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1724 microversion: 2.20 time: 0.181497 Sep 01 05:36:49.781444 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 440/903] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:49 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:49.872608 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:49.882472 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-17843cab-3427-4475-9c7e-95ee4f0ef9b1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1722 microversion: 2.1 time: 0.173245 Sep 01 05:36:49.883372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 464/904] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:49 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:50.678920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-d2122c9a-2749-492b-9693-2c71ae7b8d5c req-35330d4e-478f-4b75-8b4f-c983f7010f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e750cb-b7bf-46f8-945d-51866ebb4c2e", "name": "network-vif-deleted", "tag": "cecbb19c-0368-43b2-a813-da4b7b5869a1"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:50.689876 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-d2122c9a-2749-492b-9693-2c71ae7b8d5c req-35330d4e-478f-4b75-8b4f-c983f7010f2d service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.690369 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-d2122c9a-2749-492b-9693-2c71ae7b8d5c req-35330d4e-478f-4b75-8b4f-c983f7010f2d service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.690802 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-d2122c9a-2749-492b-9693-2c71ae7b8d5c req-35330d4e-478f-4b75-8b4f-c983f7010f2d service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.704070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-d2122c9a-2749-492b-9693-2c71ae7b8d5c req-35330d4e-478f-4b75-8b4f-c983f7010f2d service nova] Creating event network-vif-deleted:cecbb19c-0368-43b2-a813-da4b7b5869a1 for instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e on hv-cinder-83602 Sep 01 05:36:50.709464 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-d2122c9a-2749-492b-9693-2c71ae7b8d5c req-35330d4e-478f-4b75-8b4f-c983f7010f2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034276 Sep 01 05:36:50.710174 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 441/905] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:36:50.798383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:50.799237 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:50.808410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.809849 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.810475 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.811341 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.812185 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.812858 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.908786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:50.909081 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:50.909081 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:50.911425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:50.913011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f661527186794ba296b322c22a78f3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '538589fdc80248a3a3e82802151b4eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:50.914756 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-09cd5026-af36-4549-89bf-eaf8e99b4260 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 200 len: 1367 microversion: 2.20 time: 0.121049 Sep 01 05:36:50.914941 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.915431 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.915536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 465/906] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:50 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 1367 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 05:36:50.916085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:50.916850 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:50.917303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:50.917722 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.093184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:51.102049 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8f89caff-5594-4c14-a5d2-88eda77ec1a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1699 microversion: 2.1 time: 0.201270 Sep 01 05:36:51.102719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 442/907] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:50 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1699 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:51.123476 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cb66aa76-3829-45ee-8a68-7044d33dd44e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:36:51.130785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb66aa76-3829-45ee-8a68-7044d33dd44e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.131547 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb66aa76-3829-45ee-8a68-7044d33dd44e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.132228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cb66aa76-3829-45ee-8a68-7044d33dd44e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.156734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cb66aa76-3829-45ee-8a68-7044d33dd44e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Going to try to start instance {{(pid=121031) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:36:51.332995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cb66aa76-3829-45ee-8a68-7044d33dd44e tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/action" status: 202 len: 0 microversion: 2.1 time: 0.213602 Sep 01 05:36:51.338481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 466/908] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:36:51 2022] POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:36:51.345047 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:51.347810 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:51.360057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.362223 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.363246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.364157 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.364711 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.365270 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.545773 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:51.558012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a77a43c5-cf1e-4e22-a13d-09307fa23737 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1708 microversion: 2.1 time: 0.219332 Sep 01 05:36:51.558901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 443/909] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:51 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1708 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:51.946197 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:51.946926 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:51.954136 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.954666 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.955067 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.955968 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:51.956444 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:51.957681 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:51.971893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] HTTP exception thrown: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Request method failure captured: Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e HTTP/1.1 Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM4f-8x6Wthtkr9dzuo3JL2NQB8NKh1kDHv8FG12uCh_6CJGRchb_w0THcKGieJvaStq13VEWqbeLFhok9gj6Liv3rG62v-NdYD9YdVbxFWOZZuCkxYdgQQ5Sml-0UK-pf_2cZlVbpguJEc-6_lSnsQxqvcu7nqVxlu40ws_ldLbPg Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:51.973798 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: f661527186794ba296b322c22a78f3f0 Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:51.975700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'f0e750cb-b7bf-46f8-945d-51866ebb4c2e'} Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:51.976685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:51.978282 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:51.979835 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Returning 404 to user: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:51.979835 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-267f2165-48ac-47dc-992a-717296fb178f tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 404 len: 111 microversion: 2.20 time: 0.033915 Sep 01 05:36:51.979835 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 467/910] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:51 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:36:51.984169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b7cfd9ba-1935-4d84-87dc-dfdd58aba95a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '.version_select at 0x7f953af188b0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:52.063378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b7cfd9ba-1935-4d84-87dc-dfdd58aba95a tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589126514" status: 204 len: 0 microversion: 2.20 time: 0.082284 Sep 01 05:36:52.064077 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 444/911] 10.222.0.16 () {60 vars in 1262 bytes} [Thu Sep 1 05:36:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1589126514 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 05:36:52.581208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:52.581816 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:52.587763 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:52.588250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:52.588684 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:52.589377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:52.589834 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:52.590271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:52.723076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:52.731609 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5fa18bc6-de93-4c13-baa6-2c23015a9db4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1708 microversion: 2.1 time: 0.154256 Sep 01 05:36:52.732117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 468/912] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:52 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:53.752634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:53.753240 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:53.760515 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:53.760987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:53.761416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:53.762094 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:53.762597 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:53.763018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.118304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:36:54.127095 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a7563f1a-8d30-455a-af19-a656d27eeec4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1712 microversion: 2.1 time: 0.378927 Sep 01 05:36:54.127551 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 445/913] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:36:53 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1712 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:36:54.187779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:54.192242 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:54.194520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.194990 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.195410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.196088 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.196521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.196933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.210638 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] HTTP exception thrown: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Request method failure captured: Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e HTTP/1.1 Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM4f-8x6Wthtkr9dzuo3JL2NQB8NKh1kDHv8FG12uCh_6CJGRchb_w0THcKGieJvaStq13VEWqbeLFhok9gj6Liv3rG62v-NdYD9YdVbxFWOZZuCkxYdgQQ5Sml-0UK-pf_2cZlVbpguJEc-6_lSnsQxqvcu7nqVxlu40ws_ldLbPg Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:54.212169 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: f661527186794ba296b322c22a78f3f0 Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.216599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'f0e750cb-b7bf-46f8-945d-51866ebb4c2e'} Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:54.217450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.219033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.220770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Returning 404 to user: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:54.220770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a2b739ed-d047-4cde-bfc5-703e8d40db58 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 404 len: 111 microversion: 2.20 time: 0.029601 Sep 01 05:36:54.220770 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 469/914] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 1 05:36:54 2022] DELETE /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:36:54.222163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:54.222734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: f0e750cb-b7bf-46f8-945d-51866ebb4c2e] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:54.229655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.230127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.230588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.231268 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:54.231716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:54.232132 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:54.245613 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] HTTP exception thrown: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Request method failure captured: Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e HTTP/1.1 Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM4f-8x6Wthtkr9dzuo3JL2NQB8NKh1kDHv8FG12uCh_6CJGRchb_w0THcKGieJvaStq13VEWqbeLFhok9gj6Liv3rG62v-NdYD9YdVbxFWOZZuCkxYdgQQ5Sml-0UK-pf_2cZlVbpguJEc-6_lSnsQxqvcu7nqVxlu40ws_ldLbPg Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:36:54.247246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: f661527186794ba296b322c22a78f3f0 Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.248878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': 'f0e750cb-b7bf-46f8-945d-51866ebb4c2e'} Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:54.252746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. Sep 01 05:36:54.254248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:54.255543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Returning 404 to user: Instance f0e750cb-b7bf-46f8-945d-51866ebb4c2e could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:54.255543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-dde26e7b-e825-4825-a584-d982ab2cad69 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e" status: 404 len: 111 microversion: 2.20 time: 0.030664 Sep 01 05:36:54.255543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 446/915] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:54 2022] GET /compute/v2.1/servers/f0e750cb-b7bf-46f8-945d-51866ebb4c2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:36:55.476545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:55.477111 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:55.483535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.484002 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.484426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.485098 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.485540 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.485949 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.499100 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] HTTP exception thrown: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Request method failure captured: Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 HTTP/1.1 Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEM4f-8x6Wthtkr9dzuo3JL2NQB8NKh1kDHv8FG12uCh_6CJGRchb_w0THcKGieJvaStq13VEWqbeLFhok9gj6Liv3rG62v-NdYD9YdVbxFWOZZuCkxYdgQQ5Sml-0UK-pf_2cZlVbpguJEc-6_lSnsQxqvcu7nqVxlu40ws_ldLbPg Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:36:55.501116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: f661527186794ba296b322c22a78f3f0 Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.508784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '4659e047-b384-4220-b0d3-26e9f67354c5'} Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:55.509641 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.511109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.512561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Returning 404 to user: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:55.512561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-053a787d-f968-4583-93e6-00366213d25c tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 404 len: 111 microversion: 2.20 time: 0.029825 Sep 01 05:36:55.512561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 470/916] 10.222.0.16 () {60 vars in 1280 bytes} [Thu Sep 1 05:36:55 2022] DELETE /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:36:55.514103 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:36:55.514741 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] [instance: 4659e047-b384-4220-b0d3-26e9f67354c5] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:36:55.521622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.522117 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.522582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.523252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:36:55.523689 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:36:55.524099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:36:55.537168 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] HTTP exception thrown: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Request method failure captured: Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 HTTP/1.1 Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEM4f-8x6Wthtkr9dzuo3JL2NQB8NKh1kDHv8FG12uCh_6CJGRchb_w0THcKGieJvaStq13VEWqbeLFhok9gj6Liv3rG62v-NdYD9YdVbxFWOZZuCkxYdgQQ5Sml-0UK-pf_2cZlVbpguJEc-6_lSnsQxqvcu7nqVxlu40ws_ldLbPg Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:36:55.538688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/538589fdc80248a3a3e82802151b4eb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 538589fdc80248a3a3e82802151b4eb6 Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1865653909 Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: f661527186794ba296b322c22a78f3f0 Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1865653909-project Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.540397 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '4659e047-b384-4220-b0d3-26e9f67354c5'} Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:36:55.541274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. Sep 01 05:36:55.542724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:36:55.544029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] Returning 404 to user: Instance 4659e047-b384-4220-b0d3-26e9f67354c5 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:36:55.544029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c248d5ff-bf23-4ee0-96c0-cfc0913e0883 tempest-AttachVolumeShelveTestJSON-1865653909 tempest-AttachVolumeShelveTestJSON-1865653909-project] 10.222.0.16 "GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5" status: 404 len: 111 microversion: 2.20 time: 0.029764 Sep 01 05:36:55.544029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 447/917] 10.222.0.16 () {60 vars in 1277 bytes} [Thu Sep 1 05:36:55 2022] GET /compute/v2.1/servers/4659e047-b384-4220-b0d3-26e9f67354c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 05:37:06.250535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1345041085", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:06.259603 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:06.260281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:06.308238 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] validate_networks() for None {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:37:06.585980 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:37:06.586390 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:37:06.586873 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:37:06.587267 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:37:06.587853 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:37:06.599339 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:06.599807 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:06.600232 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:06.600947 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:06.601425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:06.601885 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:06.619927 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Getting quotas for project 6d8b94c6caa34c178d85187b2147a437. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:37:06.624129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Getting quotas for user 6232623dd58e40008a756b6904e7a612 and project 6d8b94c6caa34c178d85187b2147a437. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:37:06.635799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:37:06.638235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:37:06.799709 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b877a225-c1e5-43a8-8971-972f521de30a tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552911 Sep 01 05:37:06.800363 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 471/918] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:37:06.811479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0da8e96a-f207-4696-a629-933d18a94328 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:06.812086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0da8e96a-f207-4696-a629-933d18a94328 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:06.815895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:06.821053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=47 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:06.874750 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0da8e96a-f207-4696-a629-933d18a94328 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:06.882591 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0da8e96a-f207-4696-a629-933d18a94328 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1215 microversion: 2.1 time: 0.074774 Sep 01 05:37:06.883156 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 448/919] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:06 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:07.904625 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:07.905029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:07.910863 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.911341 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.911780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.912458 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:07.912911 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:07.913332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:07.975992 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:07.984062 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-32e7b565-1870-4ef7-b524-0714705a0669 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1219 microversion: 2.1 time: 0.084203 Sep 01 05:37:07.984659 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 472/920] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:07 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:09.006455 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:09.007096 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:09.014727 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:09.015208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:09.015642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.016325 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:09.017420 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:09.017968 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:09.100791 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:09.108361 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5d118eeb-eb1c-4767-9146-f713885c7e2e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1267 microversion: 2.1 time: 0.107114 Sep 01 05:37:09.108918 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 449/921] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:09 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:10.129138 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:10.129737 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:10.136292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.136776 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.137202 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.137882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:10.138324 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:10.138765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:10.281804 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:10.290100 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d8a53a84-5d7a-49f0-a162-5cc27c272e22 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.164807 Sep 01 05:37:10.290983 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 473/922] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:10 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:11.066458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-b876eb15-3974-4c02-9c5b-bab78221f38b req-f13f3d1f-28ef-4015-a6e9-27a6f86f638b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "938f618c-25a8-4e0d-9f1d-59fd744d4797", "tag": "a2cb5872-434c-4417-b4a1-f9e3bd3c81e9"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:11.076699 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-b876eb15-3974-4c02-9c5b-bab78221f38b req-f13f3d1f-28ef-4015-a6e9-27a6f86f638b service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.077301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-b876eb15-3974-4c02-9c5b-bab78221f38b req-f13f3d1f-28ef-4015-a6e9-27a6f86f638b service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.077799 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-b876eb15-3974-4c02-9c5b-bab78221f38b req-f13f3d1f-28ef-4015-a6e9-27a6f86f638b service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.089796 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-b876eb15-3974-4c02-9c5b-bab78221f38b req-f13f3d1f-28ef-4015-a6e9-27a6f86f638b service nova] Creating event network-changed:a2cb5872-434c-4417-b4a1-f9e3bd3c81e9 for instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 on hv-cinder-83602 Sep 01 05:37:11.095385 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-b876eb15-3974-4c02-9c5b-bab78221f38b req-f13f3d1f-28ef-4015-a6e9-27a6f86f638b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032161 Sep 01 05:37:11.096108 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 450/923] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:11.324812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:11.325437 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:11.332134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.342662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.342662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.342662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:11.342662 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:11.343285 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:11.479819 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:11.487834 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4672accd-b152-4170-91fb-9179ea6c58da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.176070 Sep 01 05:37:11.488442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 474/924] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:11 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:12.509064 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:12.509755 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:12.515827 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.518619 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.518619 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:12.518619 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:12.518619 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:12.519006 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:12.651359 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:12.659686 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cd524218-5b69-43ab-9d6a-7e2976030634 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.155196 Sep 01 05:37:12.660248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 451/925] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:12 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:13.681575 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:13.682221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:13.689303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:13.689782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:13.690215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:13.690930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:13.691388 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:13.691809 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:13.815213 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:13.822838 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4cb59e96-36b3-4947-9f21-e368366e8857 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.145580 Sep 01 05:37:13.823406 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 475/926] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:13 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:14.842650 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:14.843273 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:14.850056 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.850564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.850999 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.851674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:14.852124 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:14.852541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:14.981408 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:14.989690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fd206188-18a9-4fbf-9bef-16f831849e27 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.150947 Sep 01 05:37:14.990254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 452/927] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:14 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:16.010908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:16.012060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:16.019351 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:16.019619 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:16.020035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:16.020729 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:16.021267 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:16.021651 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:16.157731 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:16.165800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-50e7c2f2-34cc-4b1c-a0d5-f82ae46ac2f5 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.158685 Sep 01 05:37:16.166370 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 476/928] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:16 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:17.186891 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:17.187522 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:17.190481 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:17.195127 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:17.195602 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:17.196029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:17.196714 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:17.197153 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:17.197567 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:17.329666 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:17.337739 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-5bf7ef00-4ead-4eeb-b156-6fff860ad2da tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.154720 Sep 01 05:37:17.338487 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 453/929] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:17 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:17.663907 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-a805c359-e11c-4462-9612-02855c45116a req-bdd07e36-e97a-4043-90e9-1b746d82cbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f618c-25a8-4e0d-9f1d-59fd744d4797", "name": "network-vif-plugged", "status": "completed", "tag": "a2cb5872-434c-4417-b4a1-f9e3bd3c81e9"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:17.668750 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:17.669425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:17.675994 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a805c359-e11c-4462-9612-02855c45116a req-bdd07e36-e97a-4043-90e9-1b746d82cbfc service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:17.676473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a805c359-e11c-4462-9612-02855c45116a req-bdd07e36-e97a-4043-90e9-1b746d82cbfc service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:17.676897 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-a805c359-e11c-4462-9612-02855c45116a req-bdd07e36-e97a-4043-90e9-1b746d82cbfc service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:17.690202 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-a805c359-e11c-4462-9612-02855c45116a req-bdd07e36-e97a-4043-90e9-1b746d82cbfc service nova] Creating event network-vif-plugged:a2cb5872-434c-4417-b4a1-f9e3bd3c81e9 for instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 on hv-cinder-83602 Sep 01 05:37:17.696721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-a805c359-e11c-4462-9612-02855c45116a req-bdd07e36-e97a-4043-90e9-1b746d82cbfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036570 Sep 01 05:37:17.697456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 477/930] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:18.358755 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:18.359300 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:18.366263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:18.366771 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:18.367197 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:18.367866 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:18.368306 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:18.368717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:18.494347 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:18.501858 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b85b5d37-dabe-4c42-a4a7-67c88e16f7cc tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.147121 Sep 01 05:37:18.502460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 454/931] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:18 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:19.523531 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:19.524224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:19.531487 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:19.532020 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:19.537835 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:19.537835 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:19.537835 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:19.537835 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:19.667918 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:19.676274 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-76a781de-eab7-4448-bfad-f865fb2641cd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1315 microversion: 2.1 time: 0.157472 Sep 01 05:37:19.676842 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 478/932] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:19 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:20.697256 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:20.697815 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:20.703984 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:20.705231 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:20.708142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:20.708142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:20.708142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:20.708142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:20.833749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:20.841437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d558915e-d760-454d-8a48-5889dc904c46 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1464 microversion: 2.1 time: 0.148231 Sep 01 05:37:20.841998 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 455/933] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:20 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:20.885459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:20.891301 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:20.892718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:20.893195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:20.893625 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:20.894305 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:20.894782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:20.895200 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:20.920275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:37:21.225365 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5efc69c1-7650-44c7-acd4-76557dfc2b5e tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "DELETE /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 204 len: 0 microversion: 2.1 time: 0.343496 Sep 01 05:37:21.225952 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 479/934] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:37:20 2022] DELETE /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:37:21.234102 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:21.234754 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:21.241270 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:21.241740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:21.242163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:21.242864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:21.243305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:21.243717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:21.380121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:21.387814 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e86d4d3f-ba38-4a3d-8ea3-c3b3795f3edd tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1470 microversion: 2.1 time: 0.157567 Sep 01 05:37:21.388382 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 456/935] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:21 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:22.409312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:22.410018 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:22.416640 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.417116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.417550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.418238 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:22.418718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:22.419139 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:22.557012 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:22.565445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-87b69d4e-e5d4-4523-b50c-72ad40b3a1d1 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1470 microversion: 2.1 time: 0.160496 Sep 01 05:37:22.566013 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 480/936] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:22 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:23.407808 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-cb9825b9-1420-4244-88cd-c2c63825b028 req-2037c286-04e3-4db9-b8bd-34670300a5cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "938f618c-25a8-4e0d-9f1d-59fd744d4797", "name": "network-vif-deleted", "tag": "a2cb5872-434c-4417-b4a1-f9e3bd3c81e9"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:23.418103 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-cb9825b9-1420-4244-88cd-c2c63825b028 req-2037c286-04e3-4db9-b8bd-34670300a5cc service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.418615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-cb9825b9-1420-4244-88cd-c2c63825b028 req-2037c286-04e3-4db9-b8bd-34670300a5cc service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.419029 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-cb9825b9-1420-4244-88cd-c2c63825b028 req-2037c286-04e3-4db9-b8bd-34670300a5cc service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:23.433831 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-cb9825b9-1420-4244-88cd-c2c63825b028 req-2037c286-04e3-4db9-b8bd-34670300a5cc service nova] Creating event network-vif-deleted:a2cb5872-434c-4417-b4a1-f9e3bd3c81e9 for instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 on hv-cinder-83602 Sep 01 05:37:23.441488 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-cb9825b9-1420-4244-88cd-c2c63825b028 req-2037c286-04e3-4db9-b8bd-34670300a5cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037422 Sep 01 05:37:23.442337 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 457/937] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:37:23.587025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:23.587637 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:23.594688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.595176 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.595598 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:23.596617 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:23.597141 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:23.597570 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:23.659318 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6232623dd58e40008a756b6904e7a612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8b94c6caa34c178d85187b2147a437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:23.667155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f73d4529-d0b7-4038-9ee7-16cfc63317fa tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 200 len: 1300 microversion: 2.1 time: 0.084557 Sep 01 05:37:23.667717 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 481/938] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:23 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:37:24.689890 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:24.690347 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] [instance: 938f618c-25a8-4e0d-9f1d-59fd744d4797] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:24.696340 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:24.696943 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:24.697380 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:24.698075 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:24.698578 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:24.698983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:24.713182 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] HTTP exception thrown: Instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 could not be found. Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Request method failure captured: Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 HTTP/1.1 Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEUAu2mI0A2YOd9mlCAqD1YbQCJdSz8G7YKwLqsbS_TZXhkOj_re5eWEEtcYZiFDJYXLNhalFgFmdHVuMLnTACcAJEmh_bQEoEY5J_FXHdhny1FQj7i3gW2HuGZZkTrr2bPzchqloeCjsodMOlfrjtXTUxQNNyda1y00yVDbrjwZSOw Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 6d8b94c6caa34c178d85187b2147a437 Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-VolumesNegativeTest-1544688366 Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:37:24.714881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6d8b94c6caa34c178d85187b2147a437"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8b94c6caa34c178d85187b2147a437"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6d8b94c6caa34c178d85187b2147a437"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6d8b94c6caa34c178d85187b2147a437"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-VolumesNegativeTest-1544688366 Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 6d8b94c6caa34c178d85187b2147a437 Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-VolumesNegativeTest-1544688366 Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-VolumesNegativeTest-1544688366-project Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 6232623dd58e40008a756b6904e7a612 Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-VolumesNegativeTest-1544688366-project Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 could not be found. Sep 01 05:37:24.716756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '938f618c-25a8-4e0d-9f1d-59fd744d4797'} Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 could not be found. Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:37:24.717710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 could not be found. Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 could not be found. Sep 01 05:37:24.719215 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:37:24.721162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] Returning 404 to user: Instance 938f618c-25a8-4e0d-9f1d-59fd744d4797 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:37:24.721162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-08ecc569-8930-4262-890a-e06b3c3156b7 tempest-VolumesNegativeTest-1544688366 tempest-VolumesNegativeTest-1544688366-project] 10.222.0.16 "GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797" status: 404 len: 111 microversion: 2.1 time: 0.031641 Sep 01 05:37:24.721162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 458/939] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:24 2022] GET /compute/v2.1/servers/938f618c-25a8-4e0d-9f1d-59fd744d4797 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:37:27.398317 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:27.399029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:27.406032 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:27.406539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:27.407528 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:27.408224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:27.408679 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:27.409191 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:27.508043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lazy-loading 'services' on Instance uuid 52f30586-8ff8-4c6a-844d-dd76b18c6656 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:37:27.823918 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-da6ed762-2b48-4aaa-8c89-9618a6e5bc45 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/os-volume_attachments/dd6a1168-0636-44b8-ab72-2f1fa181ae9d" status: 202 len: 0 microversion: 2.1 time: 0.430370 Sep 01 05:37:27.824707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 482/940] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:37:27 2022] DELETE /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/os-volume_attachments/dd6a1168-0636-44b8-ab72-2f1fa181ae9d => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:37:28.959321 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2f7e131b-6e15-4e0c-9cab-1b90ece0cbb5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:28.967611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f7e131b-6e15-4e0c-9cab-1b90ece0cbb5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:28.968092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f7e131b-6e15-4e0c-9cab-1b90ece0cbb5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:28.968647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2f7e131b-6e15-4e0c-9cab-1b90ece0cbb5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.031407 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2f7e131b-6e15-4e0c-9cab-1b90ece0cbb5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Going to try to stop instance {{(pid=121030) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 05:37:29.199471 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2f7e131b-6e15-4e0c-9cab-1b90ece0cbb5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/action" status: 202 len: 0 microversion: 2.1 time: 0.244319 Sep 01 05:37:29.200158 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 459/941] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:37:28 2022] POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:37:29.209536 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:29.210240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:29.232164 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:29.232645 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:29.233078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.233780 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:29.234229 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:29.234718 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:29.396426 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:29.404716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b5882295-22a3-46ca-8df0-84315bf5de0f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.199267 Sep 01 05:37:29.405531 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 483/942] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:29 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:30.426804 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:30.427501 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:30.433975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:30.434476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:30.434905 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:30.435596 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:30.436042 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:30.436614 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:30.570468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:30.578311 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2c402159-b261-4d3c-9f24-17101e2e0f09 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.156966 Sep 01 05:37:30.579437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 460/943] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:30 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:31.600847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:31.601486 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:31.608702 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.609181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.609930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.610364 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:31.610933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:31.611699 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:31.749079 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:31.758032 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c6881d7c-c4ed-4edf-b607-021943bd3735 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.161116 Sep 01 05:37:31.758631 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 484/944] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:31 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:32.779035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:32.779737 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:32.786729 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:32.787324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:32.787753 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:32.788434 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:32.788877 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:32.789290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:32.923044 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:32.930887 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9551bada-09d3-415a-bb44-b97b4bdd8591 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.155573 Sep 01 05:37:32.931510 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 461/945] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:32 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:33.951848 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:33.952481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:33.958836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:33.964678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:33.964678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:33.964678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:33.964678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:33.965069 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:34.091665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:34.099920 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8437d93f-3b70-48f8-a094-ee59a41b20c8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.151904 Sep 01 05:37:34.100477 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 485/946] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:33 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:35.121652 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:35.122252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:35.129104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:35.129571 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:35.129993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:35.130739 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:35.131181 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:35.131592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:35.260761 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:35.268360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a231f521-1d6d-49b7-a04e-3941f0ad87fb tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.150564 Sep 01 05:37:35.268913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 462/947] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:35 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:36.289355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:36.290470 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:36.296410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:36.296880 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:36.297308 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:36.297979 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:36.299010 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:36.299417 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:36.317719 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:36.449436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:36.459311 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1da9f86f-0423-4b1e-81b9-e75404455bc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.173738 Sep 01 05:37:36.460042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 486/948] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:36 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:37.498427 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:37.499173 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:37.505679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:37.506148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:37.506601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:37.507267 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:37.507700 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:37.512131 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:37.784980 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:37.792481 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8b0983fb-a047-4e82-a0c7-db3833713bf2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.297930 Sep 01 05:37:37.793030 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 463/949] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:37 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:38.815532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:38.816215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:38.818371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:38.823431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:38.823924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:38.824346 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:38.825075 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:38.825518 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:38.825930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:38.954239 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:38.961857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6b266875-6ff9-4a6f-be2a-03539db6c9a5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1676 microversion: 2.1 time: 0.150931 Sep 01 05:37:38.962455 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 487/950] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:38 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:39.982605 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:39.983200 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:39.985682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=35 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:39.990977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:39.991450 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:39.991876 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:39.992544 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:39.992986 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:39.993400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:39.997303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:40.120687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:40.128731 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7787cee8-31cd-473d-be6e-7ef3b313be7c tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1653 microversion: 2.1 time: 0.149895 Sep 01 05:37:40.129279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 464/951] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:39 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:40.150095 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ecdc15f9-f887-48d6-88a2-95b76e0e37d7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:40.156973 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecdc15f9-f887-48d6-88a2-95b76e0e37d7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:40.157441 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecdc15f9-f887-48d6-88a2-95b76e0e37d7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:40.157867 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ecdc15f9-f887-48d6-88a2-95b76e0e37d7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:40.181167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ecdc15f9-f887-48d6-88a2-95b76e0e37d7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Going to try to start instance {{(pid=121031) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 05:37:40.364893 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ecdc15f9-f887-48d6-88a2-95b76e0e37d7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/action" status: 202 len: 0 microversion: 2.1 time: 0.219116 Sep 01 05:37:40.365561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 488/952] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:37:40 2022] POST /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:37:40.373557 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:40.374154 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:40.380623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:40.381083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:40.381553 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:40.382222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:40.382694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:40.383104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:40.511449 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:40.519349 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e1583383-b72c-4704-bc5e-bdf6027b54ec tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1662 microversion: 2.1 time: 0.149609 Sep 01 05:37:40.519909 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 465/953] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:40 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:41.541289 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:41.542086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:41.548234 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:41.548774 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:41.549125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:41.549800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:41.550241 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:41.550677 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:41.683929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:41.692188 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fe1a3f0a-cd1e-4b09-b8d0-c012bfdfb3ae tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1662 microversion: 2.1 time: 0.155636 Sep 01 05:37:41.692746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 489/954] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:41 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:42.712952 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:42.713573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:42.719982 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:42.720992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:42.720992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:42.721794 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:42.722248 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:42.722757 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:42.850792 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:42.858455 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d912be9a-f3d3-4bb2-9eea-6eaf720d26a4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1662 microversion: 2.1 time: 0.149494 Sep 01 05:37:42.859245 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 466/955] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:42 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:43.880901 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:37:43.881510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:37:43.888027 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:43.888444 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:43.888875 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:43.889556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:37:43.890002 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:37:43.890436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:37:44.016962 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:37:44.024642 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0558beed-7cba-45d9-b71b-76b858d6f4be tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1666 microversion: 2.1 time: 0.148208 Sep 01 05:37:44.025206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 490/956] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:37:43 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1666 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:37:57.487969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=5 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:57.488701 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=17 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:57.696955 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d4a7ab52-0c72-4fc7-a9c7-79580570dc45 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Action: 'create', calling method: .version_select at 0x7f953af18790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1942787607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiZKRVadCJ6QQScj/lu1A7Ehopzja1tX0kq9w6DvjE/7r8L44Y0QDfpZom1GWBjYMhlKKnKJl4wun15Qk6Tt3H9JpBAVjo6/Pg+BNzbIe9w8aC0qWE5LEYr75RBe36Y+w=="}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:37:57.712203 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-d4a7ab52-0c72-4fc7-a9c7-79580570dc45 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Getting quotas for project 42a5c327025a4c04bde73c77acc4a452. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:37:57.716007 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-d4a7ab52-0c72-4fc7-a9c7-79580570dc45 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Getting quotas for user 654c715e5d32487d863a65bbc77ff561 and project 42a5c327025a4c04bde73c77acc4a452. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:37:57.791929 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d4a7ab52-0c72-4fc7-a9c7-79580570dc45 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.309479 Sep 01 05:37:57.792914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 467/957] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:37:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:16.600743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2001127916", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1942787607", "security_groups": [{"name": "tempest-secgroup-smoke-2114458433"}], "networks": [{"uuid": "2a14359f-3b54-4372-bf0a-f6094dad5e45"}], "block_device_mapping_v2": [{"uuid": "f105b8f9-8426-4643-9f40-34180d7cfeaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:16.611383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:38:16.618579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:38:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 01 05:38:16.618579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=7 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:16.618579 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:16.723508 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] validate_networks() for [('2a14359f-3b54-4372-bf0a-f6094dad5e45', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:38:17.204539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:38:17.204953 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:38:17.205419 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:38:17.211222 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:38:17.211672 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:38:17.220574 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:17.223448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:17.223448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:17.223448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:17.223448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:17.223828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:17.240452 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Getting quotas for project 42a5c327025a4c04bde73c77acc4a452. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:38:17.244692 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Getting quotas for user 654c715e5d32487d863a65bbc77ff561 and project 42a5c327025a4c04bde73c77acc4a452. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:38:17.303108 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:38:17.307243 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f105b8f9-8426-4643-9f40-34180d7cfeaf',volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:38:17.721281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-947f88a7-5dbe-44a5-b813-059a3fd0837e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.125123 Sep 01 05:38:17.721914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 491/958] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:38:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 05:38:17.730781 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=4 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:17.731572 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:17.735381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3a931be0-d73e-4a87-bd09-77b4a720c490 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:17.735979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3a931be0-d73e-4a87-bd09-77b4a720c490 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:17.791882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3a931be0-d73e-4a87-bd09-77b4a720c490 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:17.801443 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3a931be0-d73e-4a87-bd09-77b4a720c490 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1089 microversion: 2.1 time: 0.072370 Sep 01 05:38:17.814446 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 468/959] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:17 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:18.822927 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-20f5a29f-fa2c-42fc-9b13-7334fc7cb324 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:18.823660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-20f5a29f-fa2c-42fc-9b13-7334fc7cb324 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:18.885640 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-20f5a29f-fa2c-42fc-9b13-7334fc7cb324 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:18.892847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-20f5a29f-fa2c-42fc-9b13-7334fc7cb324 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1089 microversion: 2.1 time: 0.073719 Sep 01 05:38:18.893413 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 492/960] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:18 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:19.447219 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:19.447879 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:19.454960 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:19.455437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:19.455874 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.456548 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:19.456997 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:19.457411 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.489834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-083ad834-c849-475f-829b-7947f5582983 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048658 Sep 01 05:38:19.490437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 469/961] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:38:19 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:38:19.556889 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:19.557432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:19.563523 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:19.563995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:19.564425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.565100 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:19.565545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:19.565960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.592545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:38:19.873187 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a7b01ad1-ab01-4bcf-b2f9-5915f4d420e3 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 204 len: 0 microversion: 2.1 time: 0.319884 Sep 01 05:38:19.873775 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 493/962] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:38:19 2022] DELETE /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:38:19.882860 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:19.883468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:19.889910 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:19.890479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:19.890915 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.891623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:19.892072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:19.892496 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.913660 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:19.914356 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:19.920470 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:19.920991 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:19.921372 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.922094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:19.922590 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:19.923007 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:19.990268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:19.999728 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f08de6db-d5aa-473b-a715-49e3ca315608 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1187 microversion: 2.1 time: 0.090307 Sep 01 05:38:20.000470 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 494/963] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:19 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:20.037118 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:20.044878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-250b647c-fc63-4967-8352-ceba10600411 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1672 microversion: 2.1 time: 0.166713 Sep 01 05:38:20.045676 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 470/964] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:19 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:21.021622 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:21.022310 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:21.029844 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:21.030455 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:21.030898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:21.031584 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:21.032034 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:21.032451 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:21.065927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:21.066600 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:21.072903 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:21.073309 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:21.073939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:21.074674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:21.075125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:21.075607 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:21.094066 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:21.102752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-bd400228-37ca-4bc0-9373-8f8da17b763f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1187 microversion: 2.1 time: 0.085413 Sep 01 05:38:21.115026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 495/965] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:21 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:21.208484 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:21.216594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9cf2eb32-5b8d-4411-9546-33e43d9a416a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1672 microversion: 2.1 time: 0.154724 Sep 01 05:38:21.217149 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 471/966] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:21 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:22.124322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:22.125102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:22.132420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:22.133226 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:22.134015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:22.135086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:22.135713 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:22.136222 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:22.210286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:22.219006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5f1fb85a-b4aa-4edd-9b78-494c283979c2 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1205 microversion: 2.1 time: 0.098249 Sep 01 05:38:22.219782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 496/967] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:22 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1205 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:22.237674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:22.238285 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:22.245741 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:22.246401 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:22.246872 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:22.247578 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:22.248156 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:22.248438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:22.552935 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:22.561827 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2bce0479-29af-4280-b6a6-98490d02dda0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1672 microversion: 2.1 time: 0.328264 Sep 01 05:38:22.562399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 472/968] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:22 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1672 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:23.243006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:23.244177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:23.253019 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.254143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.254970 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.255772 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.256468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.257008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.322923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:23.340640 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-858c12eb-6bf8-4f9b-b6c9-a55318e4f6ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1205 microversion: 2.1 time: 0.101739 Sep 01 05:38:23.341224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 497/969] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:23 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1205 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:23.547825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-6adc19d3-9882-4ec3-b910-85f22787ea03 req-da17895a-7448-4cd0-8760-8fa8d279e5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52f30586-8ff8-4c6a-844d-dd76b18c6656", "name": "network-vif-deleted", "tag": "109dec1a-0199-46f8-abd0-b6c564581a6b"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:23.563893 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6adc19d3-9882-4ec3-b910-85f22787ea03 req-da17895a-7448-4cd0-8760-8fa8d279e5e4 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.566959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6adc19d3-9882-4ec3-b910-85f22787ea03 req-da17895a-7448-4cd0-8760-8fa8d279e5e4 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.567428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6adc19d3-9882-4ec3-b910-85f22787ea03 req-da17895a-7448-4cd0-8760-8fa8d279e5e4 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.583248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:23.585839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:23.599933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.600498 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.600948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.601436 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-6adc19d3-9882-4ec3-b910-85f22787ea03 req-da17895a-7448-4cd0-8760-8fa8d279e5e4 service nova] Creating event network-vif-deleted:109dec1a-0199-46f8-abd0-b6c564581a6b for instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 on hv-cinder-83602 Sep 01 05:38:23.602114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:23.602624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:23.603208 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:23.610847 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-6adc19d3-9882-4ec3-b910-85f22787ea03 req-da17895a-7448-4cd0-8760-8fa8d279e5e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067898 Sep 01 05:38:23.620413 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 473/970] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:38:23.693768 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:23.702609 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-06146c84-d76b-4a9f-b90a-8795d31db688 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1605 microversion: 2.1 time: 0.123398 Sep 01 05:38:23.712653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 498/971] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:23 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1605 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:24.361891 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:24.362918 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:24.370168 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.370896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.371848 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.373617 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.374227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.375513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.590610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:24.608145 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9cd13352-e6ab-4da1-8727-cf50f771c679 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.250596 Sep 01 05:38:24.614092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 474/972] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:24 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:24.724123 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:24.724812 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:24.731640 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.732048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.732473 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.733154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.733647 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.734060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.775530 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:24.776011 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:24.776444 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:24.777056 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lazy-loading 'fault' on Instance uuid 52f30586-8ff8-4c6a-844d-dd76b18c6656 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:38:24.831307 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:24.843678 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8d3aa215-5b1a-4466-9557-084d788290af tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 200 len: 1328 microversion: 2.1 time: 0.123488 Sep 01 05:38:24.854470 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 499/973] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:24 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 1328 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:25.630605 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-6f4774b4-858c-48d9-acc0-2390a5495435 req-5fdce43e-4b25-47f0-8a0f-901c2499cb26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42110136-6517-4654-8a6e-0557d1d1d105", "tag": "cfc77505-638a-44b4-8e4e-7c0ffeba18c6"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:25.638454 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:25.639621 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:25.652899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6f4774b4-858c-48d9-acc0-2390a5495435 req-5fdce43e-4b25-47f0-8a0f-901c2499cb26 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.652899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6f4774b4-858c-48d9-acc0-2390a5495435 req-5fdce43e-4b25-47f0-8a0f-901c2499cb26 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.652899 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6f4774b4-858c-48d9-acc0-2390a5495435 req-5fdce43e-4b25-47f0-8a0f-901c2499cb26 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.653201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.653201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.653201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.653201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.653582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.653582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.657632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-6f4774b4-858c-48d9-acc0-2390a5495435 req-5fdce43e-4b25-47f0-8a0f-901c2499cb26 service nova] Creating event network-changed:cfc77505-638a-44b4-8e4e-7c0ffeba18c6 for instance 42110136-6517-4654-8a6e-0557d1d1d105 on hv-cinder-83602 Sep 01 05:38:25.662429 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-6f4774b4-858c-48d9-acc0-2390a5495435 req-5fdce43e-4b25-47f0-8a0f-901c2499cb26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035596 Sep 01 05:38:25.663313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 475/974] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:25.785025 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:25.793521 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-b20bf3a6-9b8c-455a-86e1-c9c0e6cbc581 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.158778 Sep 01 05:38:25.794023 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 500/975] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:25 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:25.866483 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:25.867333 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:25.873458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.874023 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.874465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.875148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:25.875593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:25.876009 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:25.889634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] HTTP exception thrown: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Request method failure captured: Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 HTTP/1.1 Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEESW-NrQQ3tzll7oA5UsUrC8iEWcgtKciaVSEzoEK2e7D3xfsV0EuF44nH8eN3_V2ifyNnZoyVEd4MSWr5h8SUdvJftvRJOs4UwXu-Y9XVgLNAviMMNBdG3LiswQz7mXr1mNJr1UBjEuzoZPSVd6dQXW7dCITOY03yPHSSN5M_H68o8 Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:38:25.891308 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdee9665c45d41be9d34ba14def64757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 9561f323e125411bb83ecce21bb085c0 Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:38:25.893043 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '52f30586-8ff8-4c6a-844d-dd76b18c6656'} Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:38:25.894394 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:38:25.896914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:38:25.904282 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Returning 404 to user: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:38:25.904282 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fb8a3c37-2b48-4750-b8c6-0b759e21bfbf tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 404 len: 111 microversion: 2.1 time: 0.030640 Sep 01 05:38:25.904282 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 476/976] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:25 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:38:25.904544 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f7842711-a735-42fc-afd7-28c305e2052f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '.version_select at 0x7f953aed2940>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:25.982479 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f7842711-a735-42fc-afd7-28c305e2052f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800586145" status: 202 len: 0 microversion: 2.1 time: 0.084574 Sep 01 05:38:25.983738 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 501/977] 10.222.0.16 () {58 vars in 1221 bytes} [Thu Sep 1 05:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1800586145 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:38:26.815108 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:26.815672 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:26.823578 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:26.824035 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:26.824472 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:26.825168 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:26.826529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:26.826529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:26.856490 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8bb36f6b-967a-4713-893f-70366fba224b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'create', calling method: .version_select at 0x7f953b115a60>, body: {"keypair": {"name": "tempest-keypair-333080139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgev+RK9P6/VoOM3SPGQDSUIR1PqxZ3GGwAKlqD4GHzY5ynF6W4/oamzJfO3+h77YQD1/3pZqtaL3jDM/M+Jp8kjhrQT6X2DlK7DAlEy+mNJ2ISUfmQ5+2m0l/96t2paA=="}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:26.875713 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-8bb36f6b-967a-4713-893f-70366fba224b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Getting quotas for project fdee9665c45d41be9d34ba14def64757. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:38:26.880279 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-8bb36f6b-967a-4713-893f-70366fba224b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Getting quotas for user 9561f323e125411bb83ecce21bb085c0 and project fdee9665c45d41be9d34ba14def64757. Resources: {'key_pairs'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:38:26.955199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8bb36f6b-967a-4713-893f-70366fba224b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102688 Sep 01 05:38:26.962129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 502/978] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:38:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:38:26.971737 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:26.981045 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3cc1f04e-7edd-4d39-8e43-978132793e32 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.170501 Sep 01 05:38:26.981611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 477/979] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:26 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:28.001176 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:28.006129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:28.006129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:28.009700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:28.010171 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:28.010626 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:28.011302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:28.011746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:28.012197 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:28.144665 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:28.152485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-83d41c60-fa7a-4045-be1b-0b71e8ae7743 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.155139 Sep 01 05:38:28.153050 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 503/980] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:27 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:29.173706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:29.174312 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:29.181477 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:29.182037 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:29.182489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:29.183178 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:29.183629 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:29.184053 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:29.373169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:29.381263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a33c63b4-49fe-4cba-b1a8-b2d660d4ddc0 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.211533 Sep 01 05:38:29.381894 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 478/981] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:29 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:29.516516 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1871407829", "imageRef": "d878ee7b-6ad1-4f46-8a4b-99ae16b696f5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "348291c1-9b67-43d8-9d29-6df8cb41ef80"}], "security_groups": [{"name": "tempest-securitygroup--1077849516"}], "key_name": "tempest-keypair-333080139", "user_data": "}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:29.622211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] validate_networks() for [('348291c1-9b67-43d8-9d29-6df8cb41ef80', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:38:29.987297 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:38:29.987746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:38:29.988214 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:38:29.988618 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:38:29.989022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:38:29.997620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:29.998097 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:29.998560 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:29.999274 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:29.999719 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:30.000140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:30.016297 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Getting quotas for project fdee9665c45d41be9d34ba14def64757. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:38:30.020271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Getting quotas for user 9561f323e125411bb83ecce21bb085c0 and project fdee9665c45d41be9d34ba14def64757. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:38:30.031582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:38:30.033842 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d878ee7b-6ad1-4f46-8a4b-99ae16b696f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:38:30.161037 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-88b52bac-bafa-4528-be27-348a672ced35 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648829 Sep 01 05:38:30.161782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 504/982] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:38:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:38:30.172834 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3574340d-0577-4a6b-88cd-a62f2fb1d2e0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:30.173501 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3574340d-0577-4a6b-88cd-a62f2fb1d2e0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:30.175424 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:30.228152 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3574340d-0577-4a6b-88cd-a62f2fb1d2e0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:30.234901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3574340d-0577-4a6b-88cd-a62f2fb1d2e0 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1237 microversion: 2.1 time: 0.065790 Sep 01 05:38:30.246907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 479/983] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:30 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:30.403030 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:30.403685 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:30.409626 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:30.410101 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:30.410552 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:30.411279 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:30.411669 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:30.412128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:30.546530 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:30.555801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-739c3630-0daf-457b-8a9e-cae557867a95 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.157167 Sep 01 05:38:30.556485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 505/984] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:30 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:31.255852 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:31.256375 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:31.263546 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:31.264006 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:31.264436 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:31.265112 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:31.265579 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:31.265976 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:31.326674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:31.334280 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d8da3f27-7ad2-4917-9670-8a82abb7e4e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1241 microversion: 2.1 time: 0.082434 Sep 01 05:38:31.334858 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 480/985] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:31 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:31.576525 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:31.577134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:31.584460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:31.585046 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:31.585481 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:31.586170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:31.586675 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:31.587601 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:31.731342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:31.738965 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d0dfb135-1a9c-45ca-a48b-7913341a03ab tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.166414 Sep 01 05:38:31.739808 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 506/986] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:31 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:32.354749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:32.355354 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:32.361954 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:32.362364 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:32.362829 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:32.363516 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:32.363962 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:32.364379 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:32.445597 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:32.454075 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-af47e171-3bf7-48d3-bc2f-b15489c604f6 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1297 microversion: 2.1 time: 0.103356 Sep 01 05:38:32.454659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 481/987] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:32 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:32.759925 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:32.760602 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:32.767195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:32.767716 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:32.768139 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:32.768814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:32.769296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:32.769708 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:32.904566 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:32.912263 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7697c55e-b0f1-43f0-9a3e-bb9617636e3a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.156164 Sep 01 05:38:32.912830 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 507/988] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:32 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:33.475487 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:33.476094 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:33.482217 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.482733 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.483162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.484045 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.484496 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.485092 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.642506 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:33.650107 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-888b9f06-c798-4eeb-950e-1b61b28a716f tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1363 microversion: 2.1 time: 0.178366 Sep 01 05:38:33.650687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 482/989] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:33 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:33.934570 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:33.935181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:33.941484 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.941956 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.942382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:33.943077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:33.943520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:33.943935 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.016140 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-329c8402-f963-4cbd-8f36-dd4cfd95b2bc req-b85e0905-c315-4428-9c75-a3bc85a755d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5acb82a7-51f7-416b-a0a4-3a6db1c8b63c", "tag": "a2f61d28-1d5b-4dab-b0ae-6c65e7bba511"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:34.030818 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-329c8402-f963-4cbd-8f36-dd4cfd95b2bc req-b85e0905-c315-4428-9c75-a3bc85a755d7 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.031974 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-329c8402-f963-4cbd-8f36-dd4cfd95b2bc req-b85e0905-c315-4428-9c75-a3bc85a755d7 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.031974 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-329c8402-f963-4cbd-8f36-dd4cfd95b2bc req-b85e0905-c315-4428-9c75-a3bc85a755d7 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.050444 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-329c8402-f963-4cbd-8f36-dd4cfd95b2bc req-b85e0905-c315-4428-9c75-a3bc85a755d7 service nova] Creating event network-changed:a2f61d28-1d5b-4dab-b0ae-6c65e7bba511 for instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c on hv-cinder-83602 Sep 01 05:38:34.061691 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-329c8402-f963-4cbd-8f36-dd4cfd95b2bc req-b85e0905-c315-4428-9c75-a3bc85a755d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051280 Sep 01 05:38:34.061691 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 483/990] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:38:34.084568 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:34.093092 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f3d950da-28b4-412e-b898-c50924be485d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.162710 Sep 01 05:38:34.093867 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 508/991] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:33 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:34.672158 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:34.673603 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:34.680180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.681779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.681779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.682208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:34.682688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:34.683101 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:34.853018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:34.860647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cc2ddbe1-02bc-44f6-abdc-b7f88fbdf97a tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1363 microversion: 2.1 time: 0.193187 Sep 01 05:38:34.861192 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 484/992] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:34 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:35.114657 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:35.115263 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:35.122090 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:35.122593 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:35.123022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:35.123687 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:35.124128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:35.124630 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:35.257304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:35.261213 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:35.265934 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8f38e963-0457-4fca-a255-59e7d23f3794 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.155133 Sep 01 05:38:35.266742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 509/993] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:35 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:38:35.881840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:35.882505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:35.889216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:35.889634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:35.890097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:35.890812 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:35.891344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:35.891762 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.019938 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:36.028130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-80d0641e-fdc6-4a5b-a4c8-97b13ba6d0ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1363 microversion: 2.1 time: 0.150477 Sep 01 05:38:36.028690 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 485/994] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:35 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:36.286648 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:36.287247 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:36.293972 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.294466 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.294896 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.295577 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.296019 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.296431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.353726 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-c7a9b04a-1e43-4f7b-bc44-4a9c701d907b req-d2c22c15-46a1-47e6-a464-c5ba5d682cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42110136-6517-4654-8a6e-0557d1d1d105", "name": "network-vif-plugged", "status": "completed", "tag": "cfc77505-638a-44b4-8e4e-7c0ffeba18c6"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:36.364794 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c7a9b04a-1e43-4f7b-bc44-4a9c701d907b req-d2c22c15-46a1-47e6-a464-c5ba5d682cdd service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:36.365274 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c7a9b04a-1e43-4f7b-bc44-4a9c701d907b req-d2c22c15-46a1-47e6-a464-c5ba5d682cdd service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:36.365748 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-c7a9b04a-1e43-4f7b-bc44-4a9c701d907b req-d2c22c15-46a1-47e6-a464-c5ba5d682cdd service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:36.379939 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-c7a9b04a-1e43-4f7b-bc44-4a9c701d907b req-d2c22c15-46a1-47e6-a464-c5ba5d682cdd service nova] Creating event network-vif-plugged:cfc77505-638a-44b4-8e4e-7c0ffeba18c6 for instance 42110136-6517-4654-8a6e-0557d1d1d105 on hv-cinder-83602 Sep 01 05:38:36.385330 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-c7a9b04a-1e43-4f7b-bc44-4a9c701d907b req-d2c22c15-46a1-47e6-a464-c5ba5d682cdd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035526 Sep 01 05:38:36.386138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 486/995] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:38:36.437609 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:36.445221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6a4e8ba7-673f-41fd-865f-a4c813627f70 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.162820 Sep 01 05:38:36.446794 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 510/996] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:36 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:37.050099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:37.051098 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:37.057904 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.058461 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.058828 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.059518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.059965 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.070717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.195205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:37.203322 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9d28568a-a31e-455a-a732-a0fd9a323e37 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1363 microversion: 2.1 time: 0.157940 Sep 01 05:38:37.203886 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 487/997] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:37 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:37.467611 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:37.468277 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:37.474623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.475099 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.475530 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.476210 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:37.476681 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:37.477131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:37.620024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:37.627741 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a4e3a7ae-7726-43c6-9409-a636f4a5e1be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1261 microversion: 2.1 time: 0.164158 Sep 01 05:38:37.628312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 511/998] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:37 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:38.225475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:38.227623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:38.234448 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.235684 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.236166 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.237264 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.237732 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.238158 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.371643 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.379790 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-11f57a22-79fb-4b41-b723-c3debafe6973 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1363 microversion: 2.1 time: 0.159328 Sep 01 05:38:38.381788 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 488/999] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:38 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:38.648728 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:38.649347 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:38.656013 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.656813 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.656950 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.657643 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.658093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.658549 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.794541 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.801270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a482b87a-7e55-47a0-ac53-694ae6e4e262 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1446 microversion: 2.1 time: 0.156817 Sep 01 05:38:38.801825 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 512/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:38 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:38.821801 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:38.822429 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:38.828502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.828977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.829406 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.830085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:38.830560 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:38.830982 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:38.962001 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:38.965525 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=100 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:38.970227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-53477def-757a-4e33-9330-f41e119cc98a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1446 microversion: 2.1 time: 0.152506 Sep 01 05:38:38.971772 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 489/1001] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:38 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1446 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:39.401675 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:39.402276 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:39.405264 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:39.408634 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.413993 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.413993 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:39.413993 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:39.413993 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:39.414458 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:39.540489 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:39.547742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-eeaf6996-a78d-4b9a-8c3d-ea167f7fb2d5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1363 microversion: 2.1 time: 0.150510 Sep 01 05:38:39.548310 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 513/1002] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:39 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:40.402457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-5bba2e8a-2550-436a-aa91-3bf6b4aad904 req-57f67dd9-14a7-4c4a-a620-c3b185170fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acb82a7-51f7-416b-a0a4-3a6db1c8b63c", "name": "network-vif-plugged", "status": "completed", "tag": "a2f61d28-1d5b-4dab-b0ae-6c65e7bba511"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:40.407924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:40.413192 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-5bba2e8a-2550-436a-aa91-3bf6b4aad904 req-57f67dd9-14a7-4c4a-a620-c3b185170fed service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:40.419809 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-5bba2e8a-2550-436a-aa91-3bf6b4aad904 req-57f67dd9-14a7-4c4a-a620-c3b185170fed service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:40.419809 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-5bba2e8a-2550-436a-aa91-3bf6b4aad904 req-57f67dd9-14a7-4c4a-a620-c3b185170fed service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.426331 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-5bba2e8a-2550-436a-aa91-3bf6b4aad904 req-57f67dd9-14a7-4c4a-a620-c3b185170fed service nova] Creating event network-vif-plugged:a2f61d28-1d5b-4dab-b0ae-6c65e7bba511 for instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c on hv-cinder-83602 Sep 01 05:38:40.433075 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-5bba2e8a-2550-436a-aa91-3bf6b4aad904 req-57f67dd9-14a7-4c4a-a620-c3b185170fed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035144 Sep 01 05:38:40.433669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 490/1003] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:40.569342 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:40.570201 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:40.574491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:40.576389 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=18 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:40.584597 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:40.587233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:40.587759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.595674 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:40.596152 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:40.596581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:40.734888 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:40.742566 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-143d0260-4685-4753-a54c-8d078dfea9c5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1363 microversion: 2.1 time: 0.177211 Sep 01 05:38:40.743292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 514/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:40 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:41.479987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-011be609-b0e7-44da-a1ad-b7860125af5b req-7e117c39-dc91-4cbf-88e1-0f06bd9fafe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42110136-6517-4654-8a6e-0557d1d1d105", "tag": "cfc77505-638a-44b4-8e4e-7c0ffeba18c6"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:41.496069 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-011be609-b0e7-44da-a1ad-b7860125af5b req-7e117c39-dc91-4cbf-88e1-0f06bd9fafe6 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.496722 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-011be609-b0e7-44da-a1ad-b7860125af5b req-7e117c39-dc91-4cbf-88e1-0f06bd9fafe6 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.497947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-011be609-b0e7-44da-a1ad-b7860125af5b req-7e117c39-dc91-4cbf-88e1-0f06bd9fafe6 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.511562 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-011be609-b0e7-44da-a1ad-b7860125af5b req-7e117c39-dc91-4cbf-88e1-0f06bd9fafe6 service nova] Creating event network-changed:cfc77505-638a-44b4-8e4e-7c0ffeba18c6 for instance 42110136-6517-4654-8a6e-0557d1d1d105 on hv-cinder-83602 Sep 01 05:38:41.516699 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-011be609-b0e7-44da-a1ad-b7860125af5b req-7e117c39-dc91-4cbf-88e1-0f06bd9fafe6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042199 Sep 01 05:38:41.517451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 491/1005] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:41.763915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:41.768156 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:41.772927 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.773410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.773874 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.774596 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:41.775048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:41.775469 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:41.941096 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:41.950658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ae8938b0-091e-4e8a-a132-923f35e92ad1 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1363 microversion: 2.1 time: 0.190763 Sep 01 05:38:41.951728 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 515/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:41 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:42.976719 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:42.977416 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:42.983950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.984428 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.984862 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:42.985542 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:42.985991 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:42.986430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.112854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:38:43.120474 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-75b5f159-1a09-488c-8b25-f687a97b35b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1550 microversion: 2.1 time: 0.147947 Sep 01 05:38:43.121033 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 492/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:38:42 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:38:43.141298 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:38:43.141908 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:38:43.148211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.149412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.149843 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.150633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:43.151028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:43.151448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:43.231410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-122366ca-ec34-4562-bcb5-3819e84f41b4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094208 Sep 01 05:38:43.232001 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 516/1008] 10.222.0.16 () {58 vars in 1275 bytes} [Thu Sep 1 05:38:43 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:38:44.627121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-aca277c9-0ffa-49ab-a288-f2ca0675094d req-76c529b2-6b76-426b-9677-52313de0a97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5acb82a7-51f7-416b-a0a4-3a6db1c8b63c", "tag": "a2f61d28-1d5b-4dab-b0ae-6c65e7bba511"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:38:44.637813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-aca277c9-0ffa-49ab-a288-f2ca0675094d req-76c529b2-6b76-426b-9677-52313de0a97b service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:38:44.638287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-aca277c9-0ffa-49ab-a288-f2ca0675094d req-76c529b2-6b76-426b-9677-52313de0a97b service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:38:44.639301 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-aca277c9-0ffa-49ab-a288-f2ca0675094d req-76c529b2-6b76-426b-9677-52313de0a97b service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:38:44.650483 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-aca277c9-0ffa-49ab-a288-f2ca0675094d req-76c529b2-6b76-426b-9677-52313de0a97b service nova] Creating event network-changed:a2f61d28-1d5b-4dab-b0ae-6c65e7bba511 for instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c on hv-cinder-83602 Sep 01 05:38:44.655706 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-aca277c9-0ffa-49ab-a288-f2ca0675094d req-76c529b2-6b76-426b-9677-52313de0a97b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032006 Sep 01 05:38:44.658534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 493/1009] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:21.173749 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:21.174522 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=40 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:21.178340 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:21.178866 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:21.184646 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:21.185125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:21.188192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:21.188192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:21.188192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:21.188192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:21.210037 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e4e37624-d038-49a3-84c6-c8fc704fa371 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/ips" status: 200 len: 146 microversion: 2.1 time: 0.038006 Sep 01 05:39:21.210680 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 517/1010] 10.222.0.16 () {58 vars in 1248 bytes} [Thu Sep 1 05:39:21 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:22.798820 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=56 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:22.799553 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=12 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:22.803761 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7eeb47a7-3307-4df5-a234-0302073dc081"}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:22.806131 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:22.812146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:22.813505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:22.813505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:22.813702 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:22.814131 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:22.814589 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:23.708728 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b9b99388-4a0d-477d-b84a-74e99fe4abc8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911623 Sep 01 05:39:23.709410 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 494/1011] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:39:22 2022] POST /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:31.237314 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:31.239600 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:31.246936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:31.254922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:31.254922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:31.254922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:31.254922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:31.255315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:31.279252 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-401499f7-7d60-4fd2-9744-8a5265abd6b7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046474 Sep 01 05:39:31.279814 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 518/1012] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:39:31 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:31.291489 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:31.292683 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:31.299550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:31.300033 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:31.300481 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:31.301169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:31.301618 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:31.302038 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:31.330184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3b0eb56c-2c1b-40dd-90fe-b58c5dc34a21 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/7eeb47a7-3307-4df5-a234-0302073dc081" status: 200 len: 194 microversion: 2.1 time: 0.043583 Sep 01 05:39:31.330854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 495/1013] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 1 05:39:31 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/7eeb47a7-3307-4df5-a234-0302073dc081 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:32.949435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68f80053-6951-4442-962b-374e2f19a509"}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:32.951775 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:32.958229 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:32.958743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:32.959174 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:32.959856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:32.960303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:32.960727 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:33.837373 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d3871578-8d44-4786-8166-d6011ba1f6ea tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "POST /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.891705 Sep 01 05:39:33.837993 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 519/1014] 10.222.0.16 () {60 vars in 1323 bytes} [Thu Sep 1 05:39:32 2022] POST /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:41.345549 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:41.347830 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:41.350622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=4 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:41.351277 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:39:41.356331 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:41.356807 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:41.357235 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:41.357913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:41.358360 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:41.358806 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:41.388840 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d7a98019-0e96-4dce-a5ee-7997a71c1a98 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047238 Sep 01 05:39:41.389390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 496/1015] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:39:41 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:41.532591 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:41.534560 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:41.539912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:41.540383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:41.540805 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:41.541483 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:41.541924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:41.542856 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:41.572211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9c50e9e9-9b95-4178-b9df-234def393340 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/7eeb47a7-3307-4df5-a234-0302073dc081" status: 200 len: 194 microversion: 2.1 time: 0.043954 Sep 01 05:39:41.572782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 520/1016] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 1 05:39:41 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/7eeb47a7-3307-4df5-a234-0302073dc081 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:41.583430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:41.583924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:41.590896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:41.591383 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:41.591854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:41.592543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:41.592985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:41.593404 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:41.674810 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lazy-loading 'services' on Instance uuid 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:39:41.883114 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-569c662e-e0f4-464e-b851-53f6f384749b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/7eeb47a7-3307-4df5-a234-0302073dc081" status: 202 len: 0 microversion: 2.1 time: 0.303516 Sep 01 05:39:41.883875 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 497/1017] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:39:41 2022] DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/7eeb47a7-3307-4df5-a234-0302073dc081 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:39:43.004364 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:43.004883 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:43.011250 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:43.011760 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:43.012189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:43.012870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:43.013313 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:43.013732 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:43.041742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7dd60cd8-5c7d-4270-be54-4197454ae5e2 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/68f80053-6951-4442-962b-374e2f19a509" status: 200 len: 194 microversion: 2.1 time: 0.041704 Sep 01 05:39:43.042833 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 521/1018] 10.222.0.16 () {58 vars in 1413 bytes} [Thu Sep 1 05:39:42 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/68f80053-6951-4442-962b-374e2f19a509 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:39:43.054699 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:43.055317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:43.062122 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:43.070476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:43.070476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:43.070476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:43.070476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:43.070896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:43.143553 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lazy-loading 'services' on Instance uuid 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:39:43.334517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a18b3721-c17c-48d9-807f-93b786577470 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/68f80053-6951-4442-962b-374e2f19a509" status: 202 len: 0 microversion: 2.1 time: 0.284547 Sep 01 05:39:43.335110 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 498/1019] 10.222.0.16 () {58 vars in 1416 bytes} [Thu Sep 1 05:39:43 2022] DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments/68f80053-6951-4442-962b-374e2f19a509 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:39:44.500493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:44.502847 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:44.509212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.509691 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.510128 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.510836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.511288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.511708 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.539708 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1f94baad-5ede-48dc-9bae-9e27dd756cc5 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043210 Sep 01 05:39:44.540249 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 522/1020] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:39:44 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:39:44.650858 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:44.653607 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:44.659771 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.660239 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.660664 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.661330 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.661766 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.662178 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.690708 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-88eb44ee-12e2-4cbe-b33c-db15c13c5657 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044688 Sep 01 05:39:44.691234 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 499/1021] 10.222.0.16 () {58 vars in 1302 bytes} [Thu Sep 1 05:39:44 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 05:39:44.750898 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:44.751391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:44.757259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.757755 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.758168 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.758882 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:44.759331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:44.759754 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:44.784619 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:39:45.124382 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dee13eb0-9368-42ec-b692-4a5d3e707548 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 204 len: 0 microversion: 2.1 time: 0.377032 Sep 01 05:39:45.124987 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 523/1022] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:39:44 2022] DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:39:45.134273 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:45.137024 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:45.142993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:45.143712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:45.144182 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:45.145062 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:45.145692 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:45.146113 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:45.280783 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:45.288627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4d36c152-49d0-4c29-9ae6-7efe90a553ac tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1674 microversion: 2.1 time: 0.159323 Sep 01 05:39:45.289183 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 500/1023] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:45 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:46.310695 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:46.311397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:46.317782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:46.318256 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:46.318721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:46.319407 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:46.319853 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:46.320271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:46.450225 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:46.458014 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0ba0da99-8a5d-451a-aa58-26c335d535c4 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1674 microversion: 2.1 time: 0.151716 Sep 01 05:39:46.458734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 524/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:46 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:47.480317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:47.480869 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:47.487517 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:47.487993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:47.488436 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:47.489104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:47.489550 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:47.489968 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:47.559944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:47.567610 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-35b57c21-b352-4512-bcc8-23fea7a94aa7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1606 microversion: 2.1 time: 0.091805 Sep 01 05:39:47.568182 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 501/1025] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:47 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1606 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:47.784713 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-380da252-7c12-4811-9bf9-b6bef6f1dac8 req-240dde66-26bb-4015-b615-d0189941c44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5acb82a7-51f7-416b-a0a4-3a6db1c8b63c", "name": "network-vif-deleted", "tag": "a2f61d28-1d5b-4dab-b0ae-6c65e7bba511"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:39:47.796801 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-380da252-7c12-4811-9bf9-b6bef6f1dac8 req-240dde66-26bb-4015-b615-d0189941c44e service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:47.797602 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-380da252-7c12-4811-9bf9-b6bef6f1dac8 req-240dde66-26bb-4015-b615-d0189941c44e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:47.798259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-380da252-7c12-4811-9bf9-b6bef6f1dac8 req-240dde66-26bb-4015-b615-d0189941c44e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:47.811126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-380da252-7c12-4811-9bf9-b6bef6f1dac8 req-240dde66-26bb-4015-b615-d0189941c44e service nova] Creating event network-vif-deleted:a2f61d28-1d5b-4dab-b0ae-6c65e7bba511 for instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c on hv-cinder-83602 Sep 01 05:39:47.816302 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-380da252-7c12-4811-9bf9-b6bef6f1dac8 req-240dde66-26bb-4015-b615-d0189941c44e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100246 Sep 01 05:39:47.818177 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 525/1026] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:39:48.589573 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:48.590113 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:48.596491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:48.597036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:48.597531 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:48.598277 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:48.598813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:48.599328 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:48.631962 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:48.632588 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:48.632911 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:48.633349 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lazy-loading 'fault' on Instance uuid 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:39:48.674921 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9561f323e125411bb83ecce21bb085c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdee9665c45d41be9d34ba14def64757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:39:48.682010 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-118e147e-c1ab-4ae7-9161-98a97f981fc9 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 200 len: 1327 microversion: 2.1 time: 0.096750 Sep 01 05:39:48.688352 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 502/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:48 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:39:49.704795 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:49.705497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:49.711644 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.712116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.712547 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.713227 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:49.713672 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:49.714688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:49.727607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] HTTP exception thrown: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Request method failure captured: Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c HTTP/1.1 Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEESW-NrQQ3tzll7oA5UsUrC8iEWcgtKciaVSEzoEK2e7D3xfsV0EuF44nH8eN3_V2ifyNnZoyVEd4MSWr5h8SUdvJftvRJOs4UwXu-Y9XVgLNAviMMNBdG3LiswQz7mXr1mNJr1UBjEuzoZPSVd6dQXW7dCITOY03yPHSSN5M_H68o8 Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:39:49.729190 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdee9665c45d41be9d34ba14def64757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 9561f323e125411bb83ecce21bb085c0 Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:49.730998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '5acb82a7-51f7-416b-a0a4-3a6db1c8b63c'} Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:39:49.731840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:49.733410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:49.735021 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Returning 404 to user: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:39:49.735021 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e4d878ca-ca62-46a1-af93-07f49a44c038 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 404 len: 111 microversion: 2.1 time: 0.030497 Sep 01 05:39:49.735021 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 526/1028] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:49 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:39:49.739119 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-224db002-5c26-4fa7-b43e-2590f94bd53d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '.version_select at 0x7f953afb4e50>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:49.810374 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-224db002-5c26-4fa7-b43e-2590f94bd53d tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333080139" status: 202 len: 0 microversion: 2.1 time: 0.074908 Sep 01 05:39:49.810969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 503/1029] 10.222.0.16 () {58 vars in 1218 bytes} [Thu Sep 1 05:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333080139 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:39:53.067730 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:53.068207 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:53.074724 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:53.075192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:53.075620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:53.076296 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:53.076741 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:53.077154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:53.090823 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] HTTP exception thrown: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Request method failure captured: Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c HTTP/1.1 Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEESW-NrQQ3tzll7oA5UsUrC8iEWcgtKciaVSEzoEK2e7D3xfsV0EuF44nH8eN3_V2ifyNnZoyVEd4MSWr5h8SUdvJftvRJOs4UwXu-Y9XVgLNAviMMNBdG3LiswQz7mXr1mNJr1UBjEuzoZPSVd6dQXW7dCITOY03yPHSSN5M_H68o8 Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:39:53.092432 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdee9665c45d41be9d34ba14def64757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 9561f323e125411bb83ecce21bb085c0 Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.094064 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '5acb82a7-51f7-416b-a0a4-3a6db1c8b63c'} Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:39:53.094948 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.096228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.097757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Returning 404 to user: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:39:53.097757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4c9b083a-fda8-4388-99b7-dd37bb7b21de tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 404 len: 111 microversion: 2.1 time: 0.029823 Sep 01 05:39:53.097757 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 527/1030] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:39:53 2022] DELETE /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:39:53.101963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:53.102594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:53.110257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:53.111564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:53.111564 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:53.111860 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:53.112263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:53.112674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:53.125518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] HTTP exception thrown: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Request method failure captured: Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c HTTP/1.1 Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEESW-NrQQ3tzll7oA5UsUrC8iEWcgtKciaVSEzoEK2e7D3xfsV0EuF44nH8eN3_V2ifyNnZoyVEd4MSWr5h8SUdvJftvRJOs4UwXu-Y9XVgLNAviMMNBdG3LiswQz7mXr1mNJr1UBjEuzoZPSVd6dQXW7dCITOY03yPHSSN5M_H68o8 Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:39:53.127172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdee9665c45d41be9d34ba14def64757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 9561f323e125411bb83ecce21bb085c0 Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.128824 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '5acb82a7-51f7-416b-a0a4-3a6db1c8b63c'} Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:39:53.129859 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. Sep 01 05:39:53.131465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:53.132967 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Returning 404 to user: Instance 5acb82a7-51f7-416b-a0a4-3a6db1c8b63c could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:39:53.132967 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e42e63a4-4b8f-4d72-900b-daef412986a8 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c" status: 404 len: 111 microversion: 2.1 time: 0.030427 Sep 01 05:39:53.132967 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 504/1031] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:53 2022] GET /compute/v2.1/servers/5acb82a7-51f7-416b-a0a4-3a6db1c8b63c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:39:54.394692 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:54.395209 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:54.401503 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:54.402510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:54.402941 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:54.403617 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:54.404061 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:54.404479 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:54.418383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] HTTP exception thrown: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Request method failure captured: Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: DELETE /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 HTTP/1.1 Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEESW-NrQQ3tzll7oA5UsUrC8iEWcgtKciaVSEzoEK2e7D3xfsV0EuF44nH8eN3_V2ifyNnZoyVEd4MSWr5h8SUdvJftvRJOs4UwXu-Y9XVgLNAviMMNBdG3LiswQz7mXr1mNJr1UBjEuzoZPSVd6dQXW7dCITOY03yPHSSN5M_H68o8 Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:39:54.419944 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdee9665c45d41be9d34ba14def64757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 9561f323e125411bb83ecce21bb085c0 Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.421806 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '52f30586-8ff8-4c6a-844d-dd76b18c6656'} Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:39:54.422826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.424377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.425922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Returning 404 to user: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:39:54.425922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-1c97e50c-1b49-4d84-8f9e-76d82670ef4b tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "DELETE /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 404 len: 111 microversion: 2.1 time: 0.030802 Sep 01 05:39:54.425922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 528/1032] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:39:54 2022] DELETE /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 05:39:54.429882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:39:54.430541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] [instance: 52f30586-8ff8-4c6a-844d-dd76b18c6656] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:39:54.436864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:54.437336 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:54.437758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:54.438479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:39:54.438925 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:39:54.439340 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:39:54.452694 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] HTTP exception thrown: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Request method failure captured: Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 HTTP/1.1 Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEESW-NrQQ3tzll7oA5UsUrC8iEWcgtKciaVSEzoEK2e7D3xfsV0EuF44nH8eN3_V2ifyNnZoyVEd4MSWr5h8SUdvJftvRJOs4UwXu-Y9XVgLNAviMMNBdG3LiswQz7mXr1mNJr1UBjEuzoZPSVd6dQXW7dCITOY03yPHSSN5M_H68o8 Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:39:54.454167 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fdee9665c45d41be9d34ba14def64757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fdee9665c45d41be9d34ba14def64757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: fdee9665c45d41be9d34ba14def64757 Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-AttachVolumeTestJSON-431092990 Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 9561f323e125411bb83ecce21bb085c0 Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-AttachVolumeTestJSON-431092990-project Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.455817 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '52f30586-8ff8-4c6a-844d-dd76b18c6656'} Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:39:54.456819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. Sep 01 05:39:54.458326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:39:54.459720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] Returning 404 to user: Instance 52f30586-8ff8-4c6a-844d-dd76b18c6656 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:39:54.459720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-949379cb-84e7-419b-a8d0-044847f6aba7 tempest-AttachVolumeTestJSON-431092990 tempest-AttachVolumeTestJSON-431092990-project] 10.222.0.16 "GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656" status: 404 len: 111 microversion: 2.1 time: 0.029634 Sep 01 05:39:54.459720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 505/1033] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:39:54 2022] GET /compute/v2.1/servers/52f30586-8ff8-4c6a-844d-dd76b18c6656 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:40:40.766850 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:40.768230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:40.773105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 05:40:40.773315 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:40:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105/action (ip 10.222.0.16) !!! Sep 01 05:40:40.774951 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:40.775803 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:40.781221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:40.781772 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:40.782269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:40.783054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:40.783582 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:40.784008 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:40.808914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lazy-loading 'flavor' on Instance uuid 42110136-6517-4654-8a6e-0557d1d1d105 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:40:41.158141 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cab2fe0e-9359-46c0-9a9d-f496297c8e14 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "POST /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105/action" status: 202 len: 0 microversion: 2.1 time: 0.395092 Sep 01 05:40:41.161924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 529/1034] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:40:40 2022] POST /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 05:40:41.168115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:41.168717 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:41.171377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:41.172138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:41.177304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:41.177776 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:41.178202 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:41.178912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:41.179365 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:41.179779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:41.321576 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:41.326651 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f4bb0c23-da1f-451d-8102-eaa60576fdfa tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.163515 Sep 01 05:40:41.327208 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 506/1035] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:41 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:42.349670 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:42.350478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:42.356612 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:42.357091 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:42.357638 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:42.358194 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:42.358759 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:42.359107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:42.495147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:42.503038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-65d39a6f-281e-4cd6-aec8-8d16efd5f37a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.159020 Sep 01 05:40:42.503751 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 530/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:42 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:43.525070 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:43.525677 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:43.533052 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:43.533521 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:43.533948 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:43.534643 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:43.535711 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:43.536121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:43.663749 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:43.671914 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7535d9d5-ed30-49e3-b112-aef96cbb822f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.151285 Sep 01 05:40:43.672476 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 507/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:43 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:40:44.692557 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:44.693155 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:44.699538 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:44.700007 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:44.700433 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:44.701099 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:44.701567 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:44.701979 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:44.828923 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:44.837153 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-78badfd4-c44a-4b22-a7d0-cd33d23539f9 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.148419 Sep 01 05:40:44.837727 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 531/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:44 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:45.858998 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:45.859598 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:45.866642 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.867116 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.867541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.868213 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:45.868653 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:45.869066 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:45.994825 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:46.002463 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-53281ef8-af8c-4d23-bea9-a078940747e5 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.147254 Sep 01 05:40:46.002967 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 508/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:45 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:47.023215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:47.023811 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:47.030193 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:47.030693 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:47.031117 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:47.031786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:47.032224 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:47.032633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:47.162026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:47.169857 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ccb4bab1-6d96-4217-9923-9a7aa906acd7 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.150486 Sep 01 05:40:47.170451 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 532/1040] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:47 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:48.191018 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:48.192096 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:48.198482 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:48.198961 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:48.199393 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:48.200078 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:48.200529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:48.200944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:48.335115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:48.342845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fc9efe6c-7940-42be-a152-e812ee7d9de4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.155650 Sep 01 05:40:48.343406 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 509/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:48 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:49.363460 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:49.364073 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:49.370331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:49.370909 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:49.371331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:49.371999 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:49.372439 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:49.372851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:49.500189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:49.507764 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-dbfa6d9e-71ed-4548-8416-77adb1d296ea tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.148165 Sep 01 05:40:49.508322 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 533/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:49 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:50.529402 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:50.530008 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:50.536463 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:50.536931 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:50.537381 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:50.538051 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:50.538515 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:50.538929 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:50.669851 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:50.678271 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-3420a295-985c-41fe-99c8-2ead65ef93a8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.152848 Sep 01 05:40:50.678864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 510/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:50 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:51.699158 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:51.700456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:51.706694 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:51.708035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:51.708462 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:51.709140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:51.709576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:51.709988 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:51.843915 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:51.851840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f76adc1f-4a2b-4269-b91e-a099a1d14e90 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.156630 Sep 01 05:40:51.852398 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 534/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:51 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:52.872975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:52.873582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:52.880138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.880589 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.881016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:52.881687 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:52.882216 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:52.882659 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:53.014513 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:53.022683 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6a71aa8f-6514-4964-81df-4e55c48e2176 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.153712 Sep 01 05:40:53.023237 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 511/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:52 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:54.044642 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:54.045258 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:54.051900 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:54.052379 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:54.052818 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:54.053503 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:54.053954 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:54.054377 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:54.182745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:54.190455 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-488bf863-104f-41a6-a16b-ca1e88d7a748 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.149966 Sep 01 05:40:54.191518 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 535/1046] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:54 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:55.211496 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:55.212128 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:55.218390 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:55.218885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:55.219312 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.219981 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:55.220423 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:55.220836 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.348812 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:55.356130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-1ed97674-4cfd-4de8-8cca-b91172dbee6c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1512 microversion: 2.1 time: 0.148464 Sep 01 05:40:55.356682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 512/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:55 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:55.376018 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:55.376602 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:55.383431 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:55.383911 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:55.384427 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.385116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:55.385561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:55.385980 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.414998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121031) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 05:40:55.807304 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-896fedd0-47c9-42eb-bfbb-83c5031225de tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "POST /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105/action" status: 202 len: 0 microversion: 2.1 time: 0.435110 Sep 01 05:40:55.808126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 536/1048] 10.222.0.16 () {60 vars in 1278 bytes} [Thu Sep 1 05:40:55 2022] POST /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:40:55.816465 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:55.818622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:55.823160 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:55.823634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:55.824057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.824740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:55.825185 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:55.825647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:55.956388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:55.964674 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-21e9cf68-7414-49a7-8f08-72149e6a082d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1520 microversion: 2.1 time: 0.152577 Sep 01 05:40:55.965246 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 513/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:55 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:56.986172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:56.987592 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:56.989843 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-323d9cd5-8b3d-42dc-81c8-72215447c5c5 req-8cd46809-12e9-44d2-866c-b414ab1d30b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42110136-6517-4654-8a6e-0557d1d1d105", "name": "network-vif-unplugged", "status": "completed", "tag": "cfc77505-638a-44b4-8e4e-7c0ffeba18c6"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:40:56.994220 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:56.994843 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:56.995287 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:56.995975 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:56.996671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:56.997193 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:57.001755 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-323d9cd5-8b3d-42dc-81c8-72215447c5c5 req-8cd46809-12e9-44d2-866c-b414ab1d30b7 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:57.002992 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-323d9cd5-8b3d-42dc-81c8-72215447c5c5 req-8cd46809-12e9-44d2-866c-b414ab1d30b7 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:57.003447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-323d9cd5-8b3d-42dc-81c8-72215447c5c5 req-8cd46809-12e9-44d2-866c-b414ab1d30b7 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:57.013999 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.compute.server_external_events [req-323d9cd5-8b3d-42dc-81c8-72215447c5c5 req-8cd46809-12e9-44d2-866c-b414ab1d30b7 service nova] Unable to find a host for instance 42110136-6517-4654-8a6e-0557d1d1d105. Dropping event network-vif-unplugged {{(pid=121031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 05:40:57.014939 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-323d9cd5-8b3d-42dc-81c8-72215447c5c5 req-8cd46809-12e9-44d2-866c-b414ab1d30b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.149085 Sep 01 05:40:57.015600 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 537/1050] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 150 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 05:40:57.176760 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:57.184800 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cacfa3b7-14d4-455b-b651-3d6bac4d4d08 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1520 microversion: 2.1 time: 0.203104 Sep 01 05:40:57.185232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 514/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:56 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:40:58.205425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:58.206022 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:58.212906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:58.213376 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:58.213800 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:58.214493 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:58.214938 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:58.215353 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:58.348954 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:58.357693 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-cecdc2b3-0dd4-4015-93d5-7bd85808dc27 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1520 microversion: 2.1 time: 0.156121 Sep 01 05:40:58.358268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 538/1052] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:58 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:40:59.377967 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:40:59.379084 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:40:59.385496 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:59.385971 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:59.386398 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:59.387104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:40:59.387551 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:40:59.387969 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:40:59.754627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:40:59.762291 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-92c00b74-4b9c-4fad-bf9e-fbbdafe3c3d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1520 microversion: 2.1 time: 0.388176 Sep 01 05:40:59.762889 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 515/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:40:59 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:00.783006 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:00.783611 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:00.790620 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:00.791086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:00.791772 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:00.792442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:00.792878 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:00.793285 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:00.922366 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:00.930290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ef872a6e-cad6-4b74-9545-6d0367757d7e tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1520 microversion: 2.1 time: 0.151098 Sep 01 05:41:00.930890 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 539/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:00 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:01.951581 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:01.952123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:01.959828 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:01.960257 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:01.960716 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:01.961456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:01.961878 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:01.962295 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:02.099767 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:02.107347 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4bde9905-40b2-4d35-b6a7-4aca6b3e3898 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1522 microversion: 2.1 time: 0.159801 Sep 01 05:41:02.107902 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 516/1055] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:01 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:03.128321 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:03.129044 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:03.135634 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:03.136107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:03.136530 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:03.137212 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:03.137654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:03.138068 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:03.270371 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:03.278129 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8508ae44-95ec-4e94-8987-ca3fdaf0abf4 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.153767 Sep 01 05:41:03.278721 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 540/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:03 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:04.300795 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:04.301389 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:04.307615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:04.308118 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:04.308541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:04.309261 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:04.309700 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:04.310112 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:04.438082 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:04.446432 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4dd457dc-5048-48a8-aca1-7cb0960b0595 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.150654 Sep 01 05:41:04.447019 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 517/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:04 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:05.467220 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:05.467830 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:05.474397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.474912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.475345 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.476026 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:05.476500 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:05.476924 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:05.606586 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:05.614485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c91c4bdd-d17b-4037-afde-6ff572cba247 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.151140 Sep 01 05:41:05.615083 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 541/1058] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:05 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:06.636321 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:06.636793 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:06.644134 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:06.644619 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:06.645055 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:06.645746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:06.646204 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:06.646649 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:06.776947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:06.785558 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7be16fbf-d8c2-4ba3-a562-483a76df9541 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.153230 Sep 01 05:41:06.786143 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 518/1059] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:06 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:07.806961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:07.807563 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:07.813537 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:07.814001 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:07.814444 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:07.815156 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:07.815551 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:07.815959 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:07.941803 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:07.949467 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a3e3c6c7-9e37-4df0-b947-7a4095021077 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.146477 Sep 01 05:41:07.950029 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 542/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:07 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:08.970004 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:08.970647 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:08.976993 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.977462 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.977890 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:08.978594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:08.979042 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:08.979460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:09.110627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:09.118991 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-95402bb9-d56a-4219-81b0-a4b4e12b86d1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.152878 Sep 01 05:41:09.119552 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 519/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:08 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:10.139870 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:10.140470 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:10.147422 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:10.147892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:10.148334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:10.151240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:10.151240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:10.151240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:10.153769 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:10.281206 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:10.288839 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7db5e741-173f-4557-b1fe-367c26564209 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.152871 Sep 01 05:41:10.289399 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 543/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:10 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:11.310483 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:11.311091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:11.317985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:11.318485 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:11.318916 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:11.319594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:11.320069 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:11.320514 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:11.451318 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:11.459609 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-857b4950-cccc-4772-a50d-1d8d4ace271a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.152986 Sep 01 05:41:11.460374 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 520/1063] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:11 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:12.480895 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:12.481531 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:12.483828 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:12.488465 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:12.488936 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:12.489363 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:12.490042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:12.490514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:12.490941 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:12.620730 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:12.628459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f9d3d78a-cf4c-4f7a-aa15-b0c904222bc1 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.151308 Sep 01 05:41:12.628959 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 544/1064] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:12 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:13.010570 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-68f9aaab-9d85-41aa-bc11-8017a6f61dcd req-93bf0416-8b1d-440c-9a44-02662d5b8f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42110136-6517-4654-8a6e-0557d1d1d105", "name": "network-vif-plugged", "status": "completed", "tag": "cfc77505-638a-44b4-8e4e-7c0ffeba18c6"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:41:13.020927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-68f9aaab-9d85-41aa-bc11-8017a6f61dcd req-93bf0416-8b1d-440c-9a44-02662d5b8f23 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.021392 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-68f9aaab-9d85-41aa-bc11-8017a6f61dcd req-93bf0416-8b1d-440c-9a44-02662d5b8f23 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.021811 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-68f9aaab-9d85-41aa-bc11-8017a6f61dcd req-93bf0416-8b1d-440c-9a44-02662d5b8f23 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:13.032427 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-68f9aaab-9d85-41aa-bc11-8017a6f61dcd req-93bf0416-8b1d-440c-9a44-02662d5b8f23 service nova] Creating event network-vif-plugged:cfc77505-638a-44b4-8e4e-7c0ffeba18c6 for instance 42110136-6517-4654-8a6e-0557d1d1d105 on hv-cinder-83602 Sep 01 05:41:13.039343 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-68f9aaab-9d85-41aa-bc11-8017a6f61dcd req-93bf0416-8b1d-440c-9a44-02662d5b8f23 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030668 Sep 01 05:41:13.039343 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 521/1065] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:41:13.649085 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:13.649683 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:13.656211 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.656681 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.657107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:13.657785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:13.658227 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:13.658734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:13.786331 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:13.794271 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f902e2b9-3d69-4541-8f3b-7e0e8f60bf1d tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.149054 Sep 01 05:41:13.794873 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 545/1066] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:13 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:14.815959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:14.816650 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:14.819236 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=33 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:14.824076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:14.824542 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:14.824996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:14.825683 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:14.826113 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:14.826561 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:14.830518 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=93 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:41:14.959575 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:14.967279 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f6f45462-b654-4099-ab1d-b32e3fd3eb85 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1578 microversion: 2.1 time: 0.155603 Sep 01 05:41:14.967849 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 522/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:14 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:41:15.988858 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:41:15.989412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:41:15.995704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:15.996171 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:15.996595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:15.997261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:41:15.997705 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:41:15.998112 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:41:16.127743 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:41:16.135863 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8b897c93-8bcd-4340-8624-4b5893baf9ae tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1565 microversion: 2.1 time: 0.150952 Sep 01 05:41:16.136420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 546/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:41:15 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:30.055456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:42:30.055991 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Thu Sep 1 05:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 (ip 10.222.0.16) !!! Sep 01 05:42:30.058688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=5 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:30.059935 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=22 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:30.061031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:42:30.061154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Sep 01 05:42:30.065504 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-abd08db6-d533-4d50-a378-f407a4166d28 req-1915cc1c-b8ed-4f0c-acbb-d6da28871c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42110136-6517-4654-8a6e-0557d1d1d105", "tag": "cfc77505-638a-44b4-8e4e-7c0ffeba18c6"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:30.072247 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:30.072479 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=5 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:30.077133 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:30.077625 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:30.089605 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-abd08db6-d533-4d50-a378-f407a4166d28 req-1915cc1c-b8ed-4f0c-acbb-d6da28871c26 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:30.094607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-abd08db6-d533-4d50-a378-f407a4166d28 req-1915cc1c-b8ed-4f0c-acbb-d6da28871c26 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:30.094607 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-abd08db6-d533-4d50-a378-f407a4166d28 req-1915cc1c-b8ed-4f0c-acbb-d6da28871c26 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:30.098326 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:30.099130 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:30.099500 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:30.100198 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:30.100778 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:30.101227 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:30.103435 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-abd08db6-d533-4d50-a378-f407a4166d28 req-1915cc1c-b8ed-4f0c-acbb-d6da28871c26 service nova] Creating event network-changed:cfc77505-638a-44b4-8e4e-7c0ffeba18c6 for instance 42110136-6517-4654-8a6e-0557d1d1d105 on hv-cinder-83602 Sep 01 05:42:30.109912 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-abd08db6-d533-4d50-a378-f407a4166d28 req-1915cc1c-b8ed-4f0c-acbb-d6da28871c26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052593 Sep 01 05:42:30.111125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 547/1069] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:42:30.132652 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:42:30.479069 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a1c5bb96-d06d-47fb-b23f-63603c1ce19f tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "DELETE /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 204 len: 0 microversion: 2.1 time: 0.425404 Sep 01 05:42:30.480116 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 523/1070] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:42:30 2022] DELETE /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 05:42:30.488799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:30.489733 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:30.496196 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:30.496666 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:30.497085 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:30.497769 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:30.498210 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:30.498682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:30.632406 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:30.644450 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-611b24ce-2b31-4ad8-b06b-2f26dd839d8a tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1571 microversion: 2.1 time: 0.160126 Sep 01 05:42:30.645369 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 548/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:30 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:31.665894 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:31.666614 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:31.673146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:31.674780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:31.674780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:31.675412 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:31.675864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:31.676289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:31.805670 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:31.813375 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-7f8982a0-62ec-4de1-b9d0-1cca014da9a6 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1452 microversion: 2.1 time: 0.151679 Sep 01 05:42:31.813962 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 524/1072] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:31 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:32.539457 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-43bc2e85-7442-48b4-9e3f-bbab02baafe8 req-1eafcabd-4ca8-4e19-8527-412ad643bdaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42110136-6517-4654-8a6e-0557d1d1d105", "name": "network-vif-deleted", "tag": "cfc77505-638a-44b4-8e4e-7c0ffeba18c6"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:32.549240 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-43bc2e85-7442-48b4-9e3f-bbab02baafe8 req-1eafcabd-4ca8-4e19-8527-412ad643bdaf service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:32.553384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-43bc2e85-7442-48b4-9e3f-bbab02baafe8 req-1eafcabd-4ca8-4e19-8527-412ad643bdaf service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:32.553384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-43bc2e85-7442-48b4-9e3f-bbab02baafe8 req-1eafcabd-4ca8-4e19-8527-412ad643bdaf service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:32.561151 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-43bc2e85-7442-48b4-9e3f-bbab02baafe8 req-1eafcabd-4ca8-4e19-8527-412ad643bdaf service nova] Creating event network-vif-deleted:cfc77505-638a-44b4-8e4e-7c0ffeba18c6 for instance 42110136-6517-4654-8a6e-0557d1d1d105 on hv-cinder-83602 Sep 01 05:42:32.566554 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-43bc2e85-7442-48b4-9e3f-bbab02baafe8 req-1eafcabd-4ca8-4e19-8527-412ad643bdaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031113 Sep 01 05:42:32.574456 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 549/1073] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:42:32.833483 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:32.834186 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:32.842290 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:32.842924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:32.843598 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:32.844495 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:32.845209 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:32.845724 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:32.918105 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:32.928232 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ee27d935-e589-4ec8-9f32-8e422f2109be tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1384 microversion: 2.1 time: 0.098718 Sep 01 05:42:32.929571 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 525/1074] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:32 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1384 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:33.951877 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:33.952577 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:33.959471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:33.959943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:33.960378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:33.961060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:33.961555 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:33.961960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:33.992700 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:33.993170 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:33.993597 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:33.994033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.objects.instance [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lazy-loading 'fault' on Instance uuid 42110136-6517-4654-8a6e-0557d1d1d105 {{(pid=121031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:42:34.039421 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654c715e5d32487d863a65bbc77ff561', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a5c327025a4c04bde73c77acc4a452', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:42:34.047412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-965b1ca2-2c6a-4c0e-91c0-789cf95b0db8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 200 len: 1225 microversion: 2.1 time: 0.100271 Sep 01 05:42:34.047978 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 550/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:33 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:42:35.069121 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:35.069730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] [instance: 42110136-6517-4654-8a6e-0557d1d1d105] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:42:35.076163 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:35.076637 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:35.077066 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:35.077745 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:42:35.078192 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:42:35.078639 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:42:35.091698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] HTTP exception thrown: Instance 42110136-6517-4654-8a6e-0557d1d1d105 could not be found. Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Request method failure captured: Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 HTTP/1.1 Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEUvra0xnEIAo7E54Rcx5VAY37xGvICJPBX4VfrzSP66h8LgMrNb50pyuYdGZLoGSoC9Nkbt1SsfMz1hqxNWYdJFIIOjGmmnEsSip-0qFIlu4W27Bytth6yf-wxsUuSIDBQkXna4oCjiIuWujyJxedTumbhKTc3DNeRwjDoSNEd_-QI Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 42a5c327025a4c04bde73c77acc4a452 Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-TestShelveInstance-303350753 Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:42:35.093345 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/42a5c327025a4c04bde73c77acc4a452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42a5c327025a4c04bde73c77acc4a452"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_42a5c327025a4c04bde73c77acc4a452"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/42a5c327025a4c04bde73c77acc4a452"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-TestShelveInstance-303350753 Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 42a5c327025a4c04bde73c77acc4a452 Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-TestShelveInstance-303350753 Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-TestShelveInstance-303350753-project Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 654c715e5d32487d863a65bbc77ff561 Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-TestShelveInstance-303350753-project Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 42110136-6517-4654-8a6e-0557d1d1d105 could not be found. Sep 01 05:42:35.095085 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '42110136-6517-4654-8a6e-0557d1d1d105'} Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42110136-6517-4654-8a6e-0557d1d1d105 could not be found. Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:42:35.096135 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42110136-6517-4654-8a6e-0557d1d1d105 could not be found. Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42110136-6517-4654-8a6e-0557d1d1d105 could not be found. Sep 01 05:42:35.097746 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:42:35.099196 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Returning 404 to user: Instance 42110136-6517-4654-8a6e-0557d1d1d105 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:42:35.099196 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-395dcaab-5beb-4288-9d74-d4fee3e2c89c tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105" status: 404 len: 111 microversion: 2.1 time: 0.029617 Sep 01 05:42:35.099196 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 526/1076] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:42:35 2022] GET /compute/v2.1/servers/42110136-6517-4654-8a6e-0557d1d1d105 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:42:35.351680 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4e0fad1d-5310-4b1c-bde4-2ec4df7733d8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] Calling method '.version_select at 0x7f953aed20d0>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:42:35.427658 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4e0fad1d-5310-4b1c-bde4-2ec4df7733d8 tempest-TestShelveInstance-303350753 tempest-TestShelveInstance-303350753-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1942787607" status: 202 len: 0 microversion: 2.1 time: 0.079777 Sep 01 05:42:35.428245 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 551/1077] 10.222.0.16 () {58 vars in 1254 bytes} [Thu Sep 1 05:42:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1942787607 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 05:42:56.111327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:56.112125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:56.277363 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d2d075d9-0d1f-419b-b56d-8b42a3ddc79e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Action: 'create', calling method: .version_select at 0x7f953e8d44c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1100268181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGF2vBPHPD3e0rtsyVj3zJgEPKz0oLPr4N3GlUyKvnSRLLXqbWowwSwxVs/Sk1QgfgxcDtCsgE5Rd5bvxSbbu6J6WaT2t3saoEfAi27lrgGJGonzGZwgvZDCiJfZ/c040Q=="}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:42:56.293838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-d2d075d9-0d1f-419b-b56d-8b42a3ddc79e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Getting quotas for project 5b65e133d42c4ffa9ee97e8a21bb4a7a. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:42:56.297748 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-d2d075d9-0d1f-419b-b56d-8b42a3ddc79e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Getting quotas for user 32df71a35841485ba9166d0cad36755d and project 5b65e133d42c4ffa9ee97e8a21bb4a7a. Resources: {'key_pairs'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:42:56.375430 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d2d075d9-0d1f-419b-b56d-8b42a3ddc79e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.269549 Sep 01 05:42:56.376228 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 527/1078] 10.222.0.16 () {60 vars in 1159 bytes} [Thu Sep 1 05:42:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:14.982418 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=18 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:14.983166 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:14.987205 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1825410895", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1100268181", "security_groups": [{"name": "tempest-secgroup-smoke-764368706"}], "block_device_mapping_v2": [{"uuid": "02f6440c-52ca-464f-aed0-78ce8434976d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2ae4cfcf-5255-4d03-ab92-e2b3bf0cb9c5"}]}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:15.098262 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] validate_networks() for [('2ae4cfcf-5255-4d03-ab92-e2b3bf0cb9c5', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:43:15.461687 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:43:15.462096 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:43:15.462589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:43:15.463015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:43:15.463416 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:43:15.471968 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:15.472425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:15.472873 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:15.473578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:15.474015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:15.474438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:15.491042 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Getting quotas for project 5b65e133d42c4ffa9ee97e8a21bb4a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:43:15.494891 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Getting quotas for user 32df71a35841485ba9166d0cad36755d and project 5b65e133d42c4ffa9ee97e8a21bb4a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:43:15.551105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:43:15.553219 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02f6440c-52ca-464f-aed0-78ce8434976d',volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:43:15.968935 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-19656df7-50b9-4c43-ad63-39c9be40cf65 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.987913 Sep 01 05:43:15.969585 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 552/1079] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:43:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:43:15.977730 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=4 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:15.978514 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:15.982371 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-c7b33508-37cf-4991-9500-4ec649f74e76 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:15.983015 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-c7b33508-37cf-4991-9500-4ec649f74e76 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:16.039344 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-c7b33508-37cf-4991-9500-4ec649f74e76 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:16.046045 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-c7b33508-37cf-4991-9500-4ec649f74e76 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1095 microversion: 2.1 time: 0.069583 Sep 01 05:43:16.046593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 528/1080] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:15 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:17.067033 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:17.067644 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:17.073760 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:17.077478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:17.077478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:17.077478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:17.077478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:17.077974 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:17.140589 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:17.148928 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-9c68c106-a783-4303-a74c-156d83ee53c6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1137 microversion: 2.1 time: 0.086209 Sep 01 05:43:17.149438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 553/1081] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:17 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:18.171469 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:18.172622 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:18.180073 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:18.180552 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:18.180979 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:18.181662 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:18.182150 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:18.182593 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:18.262720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:18.271161 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-32eaebe7-db9f-4b78-8d9a-b10ab4086a18 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1211 microversion: 2.1 time: 0.103652 Sep 01 05:43:18.271738 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 529/1082] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:18 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:19.292837 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:19.293444 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:19.300391 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.300862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.301289 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.301963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.302400 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.302840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.437275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:19.445294 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7f93eef4-a0ba-476c-ad30-9cebc4672544 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.156393 Sep 01 05:43:19.447868 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 554/1083] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:19 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:19.521169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-fa29921b-cbbd-4bee-b822-ca8fceca0ed3 req-9fb2906d-bb3d-4d0b-86ff-7c090ff43eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db56f65-42d4-4b11-8b8a-fec2c4d72f07", "tag": "cdb66e43-98b3-45d3-ad7f-56592d1e04dd"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:19.531076 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-fa29921b-cbbd-4bee-b822-ca8fceca0ed3 req-9fb2906d-bb3d-4d0b-86ff-7c090ff43eb8 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:19.531542 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-fa29921b-cbbd-4bee-b822-ca8fceca0ed3 req-9fb2906d-bb3d-4d0b-86ff-7c090ff43eb8 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:19.531987 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-fa29921b-cbbd-4bee-b822-ca8fceca0ed3 req-9fb2906d-bb3d-4d0b-86ff-7c090ff43eb8 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:19.543664 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-fa29921b-cbbd-4bee-b822-ca8fceca0ed3 req-9fb2906d-bb3d-4d0b-86ff-7c090ff43eb8 service nova] Creating event network-changed:cdb66e43-98b3-45d3-ad7f-56592d1e04dd for instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 on hv-cinder-83602 Sep 01 05:43:19.548904 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-fa29921b-cbbd-4bee-b822-ca8fceca0ed3 req-9fb2906d-bb3d-4d0b-86ff-7c090ff43eb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031827 Sep 01 05:43:19.550277 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 530/1084] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:20.466130 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:20.466785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:20.473293 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:20.473767 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:20.474197 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:20.474960 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:20.475412 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:20.475843 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:20.603910 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:20.611546 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fb841437-10e5-445d-86ca-64ad653d3f42 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.149302 Sep 01 05:43:20.612610 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 555/1085] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:20 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:21.633004 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:21.633693 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:21.640025 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:21.640539 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:21.640950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:21.641629 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:21.642091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:21.642534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:21.777480 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:21.785843 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8e69a7fc-f1a9-4ac1-8994-84470389b2a2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.157172 Sep 01 05:43:21.786398 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 531/1086] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:21 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:22.806263 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:22.806891 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:22.813316 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:22.813786 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:22.814216 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:22.815569 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:22.816050 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:22.816485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:22.944126 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:22.951846 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5207fc4f-1ef0-4102-93d6-d3c0e5b509af tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.149483 Sep 01 05:43:22.952404 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 556/1087] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:22 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:23.972172 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:23.972720 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:23.979054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:23.979527 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:23.979957 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:23.980632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:23.981086 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:23.981503 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:24.106900 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:24.114547 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cd1412b0-421a-446f-a750-45bf3f1cbad3 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.146281 Sep 01 05:43:24.115103 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 532/1088] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:23 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:25.135218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:25.135821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:25.142228 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:25.143266 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:25.143697 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:25.144365 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:25.144805 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:25.145218 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:25.275560 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:25.284217 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-782655d6-4ccb-491d-8413-b86b2a948455 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.152195 Sep 01 05:43:25.284784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 557/1089] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:25 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:26.304998 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:26.305601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:26.308028 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:26.312763 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:26.319460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:26.319460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:26.319460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:26.319460 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:26.319862 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:26.445305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:26.452946 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-664d1bd9-0f34-49d9-ab26-5e90e186acc7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.151894 Sep 01 05:43:26.453504 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 533/1090] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:26 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:27.474156 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:27.474787 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:27.476594 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:27.477268 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:27.482525 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:27.483002 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:27.483505 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:27.484183 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:27.484624 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:27.485038 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:27.615488 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:27.623197 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-f16e34db-e29b-4d1e-bf4f-46c07f6288c5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.153557 Sep 01 05:43:27.623779 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 558/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:27 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:28.644457 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:28.645072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:28.651615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:28.652097 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:28.652533 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:28.653221 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:28.653673 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:28.654105 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:28.781623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:28.790315 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ced74086-3b61-41f7-bbc4-0fc26567cb9c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.149782 Sep 01 05:43:28.790917 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 534/1092] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:28 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:29.776983 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-f79dcb94-3d54-4ea7-b787-71b684c2e126 req-9c0dc691-82ad-4052-b805-2bc904f46e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db56f65-42d4-4b11-8b8a-fec2c4d72f07", "name": "network-vif-plugged", "status": "completed", "tag": "cdb66e43-98b3-45d3-ad7f-56592d1e04dd"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:29.787826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-f79dcb94-3d54-4ea7-b787-71b684c2e126 req-9c0dc691-82ad-4052-b805-2bc904f46e62 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:29.788233 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-f79dcb94-3d54-4ea7-b787-71b684c2e126 req-9c0dc691-82ad-4052-b805-2bc904f46e62 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:29.788654 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-f79dcb94-3d54-4ea7-b787-71b684c2e126 req-9c0dc691-82ad-4052-b805-2bc904f46e62 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:29.799430 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-f79dcb94-3d54-4ea7-b787-71b684c2e126 req-9c0dc691-82ad-4052-b805-2bc904f46e62 service nova] Creating event network-vif-plugged:cdb66e43-98b3-45d3-ad7f-56592d1e04dd for instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 on hv-cinder-83602 Sep 01 05:43:29.805370 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-f79dcb94-3d54-4ea7-b787-71b684c2e126 req-9c0dc691-82ad-4052-b805-2bc904f46e62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032173 Sep 01 05:43:29.806024 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 559/1093] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:43:29.812417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:29.812417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:29.819114 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:29.819601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:29.820033 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:29.820721 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:29.821225 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:29.821762 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:29.959373 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:29.967324 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8720b191-da58-4fcd-9d31-5661797dcd2c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.160091 Sep 01 05:43:29.967892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 535/1094] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:29 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:43:30.989892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:30.990611 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:30.996725 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:30.997194 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:30.997616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:30.998284 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:30.998755 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:30.999167 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:31.132831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:31.140411 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5405d097-0a03-43bf-b9ac-d2bdc498fd10 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1266 microversion: 2.1 time: 0.155777 Sep 01 05:43:31.140963 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 560/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:30 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:32.160891 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:32.161569 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:32.167881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:32.168350 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:32.168778 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.169475 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:32.169890 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:32.170303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.297123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:32.304864 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6a127f89-4807-40d3-be92-ea434b08c6ae tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1454 microversion: 2.1 time: 0.148143 Sep 01 05:43:32.305426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 536/1096] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:32 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:32.324783 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:43:32.325389 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:43:32.331863 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:32.332335 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:32.332762 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.334059 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:32.334576 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:32.335017 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:32.462124 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:43:32.469705 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-8d433794-0320-49ec-a4b9-e3a00987475c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1454 microversion: 2.1 time: 0.148724 Sep 01 05:43:32.470270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 561/1097] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:43:32 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:43:34.441963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-6b52adf4-7005-477e-9a44-09b930e257e6 req-165b8ee1-8fa3-4acf-8c88-443a905a20f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3db56f65-42d4-4b11-8b8a-fec2c4d72f07", "tag": "cdb66e43-98b3-45d3-ad7f-56592d1e04dd"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:43:34.451597 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6b52adf4-7005-477e-9a44-09b930e257e6 req-165b8ee1-8fa3-4acf-8c88-443a905a20f5 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:43:34.452071 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6b52adf4-7005-477e-9a44-09b930e257e6 req-165b8ee1-8fa3-4acf-8c88-443a905a20f5 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:43:34.452505 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6b52adf4-7005-477e-9a44-09b930e257e6 req-165b8ee1-8fa3-4acf-8c88-443a905a20f5 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:43:34.463531 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-6b52adf4-7005-477e-9a44-09b930e257e6 req-165b8ee1-8fa3-4acf-8c88-443a905a20f5 service nova] Creating event network-changed:cdb66e43-98b3-45d3-ad7f-56592d1e04dd for instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 on hv-cinder-83602 Sep 01 05:43:34.468688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-6b52adf4-7005-477e-9a44-09b930e257e6 req-165b8ee1-8fa3-4acf-8c88-443a905a20f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085840 Sep 01 05:43:34.469606 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 537/1098] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:29.672364 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR oslo.messaging._drivers.impl_rabbit [-] [231db284-4a3f-4020-8fea-86ff2ba791be] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 05:45:29.672909 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:29.673643 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=52 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:29.678292 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:29.678797 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:29.685235 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:29.689154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:29.689154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:29.689154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:29.689154 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:29.689559 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:29.714961 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Going to try to terminate instance {{(pid=121031) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:45:30.037564 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4d5c1cdc-b1c4-4d61-841d-eb736b2008aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 204 len: 0 microversion: 2.1 time: 0.367039 Sep 01 05:45:30.038151 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 562/1099] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:45:29 2022] DELETE /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:45:30.045540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [64901793-dd6a-4ffb-9c8a-254541611c21] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 05:45:30.046180 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=22 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:30.046947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=46 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:30.052191 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:30.052955 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:30.059853 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:30.060331 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:30.060770 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:30.061454 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:30.061907 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:30.062331 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:30.251112 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:30.258996 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d1f349ca-bfce-4434-8cfc-9a6bb0cbee87 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1579 microversion: 2.1 time: 0.215541 Sep 01 05:45:30.259559 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 538/1100] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:30 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1579 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:31.280941 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:31.281636 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:31.289657 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:31.290134 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:31.290583 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:31.291255 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:31.291694 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:31.292105 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:31.297459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] [231db284-4a3f-4020-8fea-86ff2ba791be] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54374. Sep 01 05:45:31.473284 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:31.481415 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-771a333e-00f6-4794-bed5-5da7b24247bf tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1579 microversion: 2.1 time: 0.204789 Sep 01 05:45:31.481970 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 563/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:31 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1579 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:32.502854 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:32.503456 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:32.515584 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO oslo.messaging._drivers.impl_rabbit [-] [64901793-dd6a-4ffb-9c8a-254541611c21] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54382. Sep 01 05:45:32.520296 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:32.520784 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:32.521219 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:32.521913 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:32.522368 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:32.522819 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:32.619473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:32.627192 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9581d713-2732-498d-b59e-6f77c255aef1 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1512 microversion: 2.1 time: 0.128264 Sep 01 05:45:32.627761 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 539/1102] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:32 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1512 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:32.799581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-d58ac477-5fc4-4399-a4d6-10a31f0ae910 req-5ffb277d-24ca-432e-b240-2324db9fa7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3db56f65-42d4-4b11-8b8a-fec2c4d72f07", "name": "network-vif-deleted", "tag": "cdb66e43-98b3-45d3-ad7f-56592d1e04dd"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:32.812270 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d58ac477-5fc4-4399-a4d6-10a31f0ae910 req-5ffb277d-24ca-432e-b240-2324db9fa7d0 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:32.812777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d58ac477-5fc4-4399-a4d6-10a31f0ae910 req-5ffb277d-24ca-432e-b240-2324db9fa7d0 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:32.813204 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d58ac477-5fc4-4399-a4d6-10a31f0ae910 req-5ffb277d-24ca-432e-b240-2324db9fa7d0 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:32.826044 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-d58ac477-5fc4-4399-a4d6-10a31f0ae910 req-5ffb277d-24ca-432e-b240-2324db9fa7d0 service nova] Creating event network-vif-deleted:cdb66e43-98b3-45d3-ad7f-56592d1e04dd for instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 on hv-cinder-83602 Sep 01 05:45:32.831504 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-d58ac477-5fc4-4399-a4d6-10a31f0ae910 req-5ffb277d-24ca-432e-b240-2324db9fa7d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099870 Sep 01 05:45:32.832682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 564/1103] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:33.648348 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:33.648950 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:33.656115 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:33.656595 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:33.657026 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:33.657715 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:33.658162 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:33.658617 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:33.689852 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:33.690373 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:33.691016 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:33.691586 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.objects.instance [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lazy-loading 'fault' on Instance uuid 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 {{(pid=121030) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 05:45:33.734540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:33.742920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-dceab192-abb1-4be6-91ca-89d50055269b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 200 len: 1231 microversion: 2.1 time: 0.097773 Sep 01 05:45:33.743756 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 540/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:33 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:34.764349 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:34.765054 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:34.771214 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.771691 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.772125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:34.772807 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:34.773259 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:34.773682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:34.787408 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] HTTP exception thrown: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Request method failure captured: Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 HTTP/1.1 Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEZaPwxrxBHg_X7V49pdf2pZB1Oz5_wzaoCdL3agMcwlWA8D9UOq025-8yCW5bHworFg5iEOoUBtYH0MYCmbTCRPoWcCtyfP7zVQaCM75DJOi-Qio7Vxxa37AUlj_UVSHyfXVphUuzVWH8dQk-YbIzmDtT6UTycNROFzDJangdYKKGQ Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:45:34.789057 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestVolumeBootPattern-983132711 Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 32df71a35841485ba9166d0cad36755d Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:45:34.791468 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '3db56f65-42d4-4b11-8b8a-fec2c4d72f07'} Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:45:34.792403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:45:34.794143 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:45:34.795720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Returning 404 to user: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:45:34.795720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ec594f1a-6630-471b-a835-a96f6a07463c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 404 len: 111 microversion: 2.1 time: 0.030741 Sep 01 05:45:34.795720 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 565/1105] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:34 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:45:34.838027 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1634825218", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1100268181", "security_groups": [{"name": "tempest-secgroup-smoke-764368706"}], "block_device_mapping_v2": [{"uuid": "02f6440c-52ca-464f-aed0-78ce8434976d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2ae4cfcf-5255-4d03-ab92-e2b3bf0cb9c5"}]}} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:34.951529 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.network.neutron [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] validate_networks() for [('2ae4cfcf-5255-4d03-ab92-e2b3bf0cb9c5', None, None, None, None, None)] {{(pid=121030) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:45:35.363191 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Flavor limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:45:35.363629 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Image limits 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:45:35.364091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Flavor pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:45:35.364487 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Image pref 0:0:0 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:45:35.364886 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.virt.hardware [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121030) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:45:35.373317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:35.373841 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:35.374270 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:35.375012 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:35.375451 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:35.375861 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:35.392765 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Getting quotas for project 5b65e133d42c4ffa9ee97e8a21bb4a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:45:35.396688 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.quota [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Getting quotas for user 32df71a35841485ba9166d0cad36755d and project 5b65e133d42c4ffa9ee97e8a21bb4a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=121030) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:45:35.452710 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Going to run 1 instances... {{(pid=121030) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:45:35.454988 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02f6440c-52ca-464f-aed0-78ce8434976d',volume_size=None,volume_type=None)] {{(pid=121030) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:45:35.874140 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [31c7bec4-32e8-4af8-84b2-ebf496c34090] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:45:36.880630 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO oslo.messaging._drivers.impl_rabbit [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [31c7bec4-32e8-4af8-84b2-ebf496c34090] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54410. Sep 01 05:45:36.884237 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9123bc3d-1a62-428f-b37c-ab0f2ca24f30 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.050606 Sep 01 05:45:36.884881 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 541/1106] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:45:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:45:36.895574 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fd566f1e-4b9c-4f0a-bc9d-ac1b52bc2932 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:36.896173 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fd566f1e-4b9c-4f0a-bc9d-ac1b52bc2932 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:36.952567 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-fd566f1e-4b9c-4f0a-bc9d-ac1b52bc2932 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:36.960482 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fd566f1e-4b9c-4f0a-bc9d-ac1b52bc2932 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1095 microversion: 2.1 time: 0.068766 Sep 01 05:45:36.961031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 566/1107] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:36 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:37.981415 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-4b0bc51a-f537-4af0-a1f9-dd8f4adc2808 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:37.982142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-4b0bc51a-f537-4af0-a1f9-dd8f4adc2808 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:38.034054 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-4b0bc51a-f537-4af0-a1f9-dd8f4adc2808 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:38.040765 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-4b0bc51a-f537-4af0-a1f9-dd8f4adc2808 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1095 microversion: 2.1 time: 0.063675 Sep 01 05:45:38.041332 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 542/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:37 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:39.060746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5e3d102b-f815-450f-b1b6-eeb4b56d0f6b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:39.061420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5e3d102b-f815-450f-b1b6-eeb4b56d0f6b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:39.113515 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5e3d102b-f815-450f-b1b6-eeb4b56d0f6b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:39.120363 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5e3d102b-f815-450f-b1b6-eeb4b56d0f6b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1095 microversion: 2.1 time: 0.063515 Sep 01 05:45:39.120922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 567/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:39 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:40.141371 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-e40d1b4d-eb56-4fea-9880-6274346f7cd6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:40.269165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-e40d1b4d-eb56-4fea-9880-6274346f7cd6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:40.269165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-e40d1b4d-eb56-4fea-9880-6274346f7cd6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:40.269165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-e40d1b4d-eb56-4fea-9880-6274346f7cd6 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1095 microversion: 2.1 time: 0.068867 Sep 01 05:45:40.269165 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 543/1110] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:40 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:41.227636 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:41.228193 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:41.235112 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:41.235581 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:41.236003 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:41.236671 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:41.237109 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:41.237520 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:41.296290 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:41.303811 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-ad65e2fd-8824-46ed-b6c9-28079feaac91 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1145 microversion: 2.1 time: 0.080114 Sep 01 05:45:41.304367 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 568/1111] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:41 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:42.324142 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:42.324788 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:42.331254 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:42.331725 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:42.332156 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:42.332852 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:42.333295 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:42.333712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:42.393399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:42.401327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8b4514ca-265b-4c00-9d3d-290175c3e727 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1137 microversion: 2.1 time: 0.081062 Sep 01 05:45:42.401983 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 544/1112] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:42 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:43.425545 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:43.426159 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:43.434821 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:43.435310 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:43.435744 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:43.436436 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:43.436883 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:43.437303 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:43.503595 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:43.509332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-54915ea8-c407-46a2-b72b-2e1e7786306d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1211 microversion: 2.1 time: 0.089800 Sep 01 05:45:43.509918 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 569/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:43 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:44.529528 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:44.530241 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:44.536678 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:44.537091 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:44.537515 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:44.538192 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:44.538656 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:44.539072 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:44.707415 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:44.715057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-35168d93-32bb-497a-8617-f32958dc0f03 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.189431 Sep 01 05:45:44.728828 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 545/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:44 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:44.800249 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-200f2bc3-b049-49b2-85fb-f09d0318ff91 req-fd3d4649-bd9e-4a28-a492-ac0ff281a598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefc5e0d-386e-47e7-9adf-adcb740458ae", "tag": "cb932aa3-d95e-4deb-aba5-c78d19f36bdb"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:44.810922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-200f2bc3-b049-49b2-85fb-f09d0318ff91 req-fd3d4649-bd9e-4a28-a492-ac0ff281a598 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:44.811394 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-200f2bc3-b049-49b2-85fb-f09d0318ff91 req-fd3d4649-bd9e-4a28-a492-ac0ff281a598 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:44.811819 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-200f2bc3-b049-49b2-85fb-f09d0318ff91 req-fd3d4649-bd9e-4a28-a492-ac0ff281a598 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:44.823071 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-200f2bc3-b049-49b2-85fb-f09d0318ff91 req-fd3d4649-bd9e-4a28-a492-ac0ff281a598 service nova] Creating event network-changed:cb932aa3-d95e-4deb-aba5-c78d19f36bdb for instance eefc5e0d-386e-47e7-9adf-adcb740458ae on hv-cinder-83602 Sep 01 05:45:44.827867 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-200f2bc3-b049-49b2-85fb-f09d0318ff91 req-fd3d4649-bd9e-4a28-a492-ac0ff281a598 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031924 Sep 01 05:45:44.828459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 570/1115] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:45.735658 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:45.736179 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:45.737992 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:45.743157 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:45.743627 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:45.744057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:45.744735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:45.745184 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:45.745599 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:45.877712 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:45.885268 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-0478a375-b48e-417c-a798-9e6fddf9c524 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.153539 Sep 01 05:45:45.885835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 546/1116] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:45 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:46.908626 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:46.909248 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:46.915532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:46.916005 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:46.916445 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:46.917180 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:46.917627 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:46.918086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:47.054485 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:47.062131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-92a338bb-3b4f-48a8-a10e-4c1835f6cc48 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.158372 Sep 01 05:45:47.062719 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 571/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:46 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:48.082927 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:48.083568 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:48.089876 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:48.090944 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:48.091380 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:48.092066 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:48.092516 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:48.092966 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:48.228214 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:48.235882 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-6dd3dc30-1c5d-4da3-a179-aca4c9d85900 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.156882 Sep 01 05:45:48.236443 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 547/1118] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:48 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:49.256182 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:49.256746 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:49.259070 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=4 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.264397 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:49.264873 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:49.265288 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:49.265957 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:49.266398 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:49.273979 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:49.395519 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:49.403420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-0fccc745-e801-4719-a418-4c8902103d21 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.151218 Sep 01 05:45:49.409979 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 572/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:49 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:50.423734 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:50.424371 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:50.426740 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=10 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:50.431534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:50.434123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:50.434123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:50.434123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:50.434123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:50.434570 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:50.565895 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:50.573758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d777333b-84f1-4e8a-b051-4bb36e2bd535 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.154006 Sep 01 05:45:50.574425 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 548/1120] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:50 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:51.594300 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:51.594943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:51.601383 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:51.601853 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:51.602281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:51.602995 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:51.603439 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:51.603855 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:51.736777 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:51.744349 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-34c74488-9b52-4107-9d9f-c006ad255a15 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.153922 Sep 01 05:45:51.744904 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 573/1121] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:51 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:52.765700 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:52.766426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:52.772744 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:52.773220 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:52.773908 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:52.774624 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:52.775073 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:52.775492 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:52.910140 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:52.917766 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f60ae10e-1cb7-4a63-b2d7-67e088caf7aa tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.156586 Sep 01 05:45:52.918383 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 549/1122] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:52 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:53.938230 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:53.938826 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:53.945181 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:53.945650 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:53.946073 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:53.946836 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:53.947275 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:53.947686 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.073932 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:54.082112 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-03aa16a8-2803-4f9c-811a-168f8c50d30d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.147752 Sep 01 05:45:54.082705 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 574/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:53 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:54.494932 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-74a8e7bb-12e4-40f1-9fcd-cdf1e3f99839 req-7781fa19-e423-45da-8302-6122435f0a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefc5e0d-386e-47e7-9adf-adcb740458ae", "name": "network-vif-plugged", "status": "completed", "tag": "cb932aa3-d95e-4deb-aba5-c78d19f36bdb"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:54.505791 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-74a8e7bb-12e4-40f1-9fcd-cdf1e3f99839 req-7781fa19-e423-45da-8302-6122435f0a90 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:54.506298 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-74a8e7bb-12e4-40f1-9fcd-cdf1e3f99839 req-7781fa19-e423-45da-8302-6122435f0a90 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:54.506792 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-74a8e7bb-12e4-40f1-9fcd-cdf1e3f99839 req-7781fa19-e423-45da-8302-6122435f0a90 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:54.517638 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-74a8e7bb-12e4-40f1-9fcd-cdf1e3f99839 req-7781fa19-e423-45da-8302-6122435f0a90 service nova] Creating event network-vif-plugged:cb932aa3-d95e-4deb-aba5-c78d19f36bdb for instance eefc5e0d-386e-47e7-9adf-adcb740458ae on hv-cinder-83602 Sep 01 05:45:54.521123 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR oslo.messaging._drivers.impl_rabbit [req-74a8e7bb-12e4-40f1-9fcd-cdf1e3f99839 req-7781fa19-e423-45da-8302-6122435f0a90 service nova] [862a5eca-1018-458a-939f-853e568423e7] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:45:55.104736 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:55.105334 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:55.113406 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:55.114076 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:55.114667 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:55.115471 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:55.116016 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:55.116529 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:55.244323 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:55.251906 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-09078e94-97f1-444b-8ce3-4746e288d92b tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.151000 Sep 01 05:45:55.252459 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 575/1124] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:55 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 05:45:55.528107 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO oslo.messaging._drivers.impl_rabbit [req-74a8e7bb-12e4-40f1-9fcd-cdf1e3f99839 req-7781fa19-e423-45da-8302-6122435f0a90 service nova] [862a5eca-1018-458a-939f-853e568423e7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54466. Sep 01 05:45:55.532303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-74a8e7bb-12e4-40f1-9fcd-cdf1e3f99839 req-7781fa19-e423-45da-8302-6122435f0a90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.041218 Sep 01 05:45:55.532905 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 550/1125] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:45:56.272475 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:56.273077 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:56.279617 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:56.280704 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:56.281125 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:56.281794 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:56.282229 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:56.282661 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:56.416000 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:56.420698 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-2ad97065-cd96-4a07-9ef6-e80875748540 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1266 microversion: 2.1 time: 0.152041 Sep 01 05:45:56.421255 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 576/1126] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:56 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:57.441263 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:57.441989 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:57.448303 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.448780 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.449205 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.449885 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.450426 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.455691 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.582300 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:57.590113 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-2fb91d28-d354-4696-8dba-6886677d644c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1453 microversion: 2.1 time: 0.153754 Sep 01 05:45:57.590707 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 551/1127] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:57 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:57.610664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:45:57.611272 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:45:57.617797 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.618325 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.618758 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.619442 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:57.619914 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:57.620330 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:57.748667 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:45:57.756362 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-7a4ee84d-77f5-4ce2-83bf-d2861b58c386 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1453 microversion: 2.1 time: 0.149539 Sep 01 05:45:57.756921 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 577/1128] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:45:57 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:45:59.870611 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-8d239f02-763a-47a4-aff5-0edc969bfad0 req-eeea7b55-5781-425e-a185-3091398cb03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefc5e0d-386e-47e7-9adf-adcb740458ae", "tag": "cb932aa3-d95e-4deb-aba5-c78d19f36bdb"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:45:59.880315 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8d239f02-763a-47a4-aff5-0edc969bfad0 req-eeea7b55-5781-425e-a185-3091398cb03c service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:45:59.880839 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8d239f02-763a-47a4-aff5-0edc969bfad0 req-eeea7b55-5781-425e-a185-3091398cb03c service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:45:59.881262 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-8d239f02-763a-47a4-aff5-0edc969bfad0 req-eeea7b55-5781-425e-a185-3091398cb03c service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:45:59.892417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-8d239f02-763a-47a4-aff5-0edc969bfad0 req-eeea7b55-5781-425e-a185-3091398cb03c service nova] Creating event network-changed:cb932aa3-d95e-4deb-aba5-c78d19f36bdb for instance eefc5e0d-386e-47e7-9adf-adcb740458ae on hv-cinder-83602 Sep 01 05:45:59.897317 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-8d239f02-763a-47a4-aff5-0edc969bfad0 req-eeea7b55-5781-425e-a185-3091398cb03c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030483 Sep 01 05:45:59.898685 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 552/1129] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:34.553617 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:34.554360 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:34.555531 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:47:34.555690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:47:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 01 05:47:34.557479 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:47:34.557626 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Thu Sep 1 05:47:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Sep 01 05:47:34.562279 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-311242749", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1100268181", "security_groups": [{"name": "tempest-secgroup-smoke-764368706"}], "block_device_mapping_v2": [{"uuid": "528145c5-4c40-4476-ac76-2645da0c7cd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2ae4cfcf-5255-4d03-ab92-e2b3bf0cb9c5"}]}} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:34.681986 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.network.neutron [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] validate_networks() for [('2ae4cfcf-5255-4d03-ab92-e2b3bf0cb9c5', None, None, None, None, None)] {{(pid=121031) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 05:47:35.102929 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Flavor limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 05:47:35.103344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Image limits 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 05:47:35.103862 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Flavor pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 05:47:35.104261 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Image pref 0:0:0 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 05:47:35.104664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.virt.hardware [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 05:47:35.113286 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:35.113765 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:35.114192 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:35.115535 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:35.115984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:35.116403 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:35.132614 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Getting quotas for project 5b65e133d42c4ffa9ee97e8a21bb4a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 05:47:35.136506 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.quota [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Getting quotas for user 32df71a35841485ba9166d0cad36755d and project 5b65e133d42c4ffa9ee97e8a21bb4a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=121031) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 05:47:35.192300 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Going to run 1 instances... {{(pid=121031) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 05:47:35.194462 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='528145c5-4c40-4476-ac76-2645da0c7cd0',volume_size=None,volume_type=None)] {{(pid=121031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 05:47:35.598319 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4dc0fb2b-6e28-4c6a-b67c-2dedde908440 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.046363 Sep 01 05:47:35.599851 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 578/1130] 10.222.0.16 () {60 vars in 1147 bytes} [Thu Sep 1 05:47:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 05:47:35.608671 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR oslo.messaging._drivers.impl_rabbit [-] [64901793-dd6a-4ffb-9c8a-254541611c21] AMQP server on 10.222.0.16:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 01 05:47:35.609314 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:35.610066 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=68 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:35.610860 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:47:35.611006 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Thu Sep 1 05:47:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 (ip 10.222.0.16) !!! Sep 01 05:47:35.616603 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-d311a289-c1d3-46b6-bc62-02bff4071fd4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:35.617305 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-d311a289-c1d3-46b6-bc62-02bff4071fd4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:35.679319 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-d311a289-c1d3-46b6-bc62-02bff4071fd4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:35.688104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-d311a289-c1d3-46b6-bc62-02bff4071fd4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1094 microversion: 2.1 time: 0.081499 Sep 01 05:47:35.688670 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 553/1131] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:35 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:36.708254 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:36.708865 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:36.715149 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:36.715677 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:36.716107 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:36.716793 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:36.717238 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:36.717656 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:36.784162 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:36.794799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-e80fe973-d6b7-4f0c-97ea-7143062a5f4d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1144 microversion: 2.1 time: 0.091009 Sep 01 05:47:36.795694 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 579/1132] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:36 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:37.816784 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:37.817384 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:37.826064 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:37.826574 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:37.827007 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:37.827764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:37.828211 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:37.828823 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:37.847335 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO oslo.messaging._drivers.impl_rabbit [-] [64901793-dd6a-4ffb-9c8a-254541611c21] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54582. Sep 01 05:47:38.174003 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:38.183057 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8e18901f-31ca-41a1-81f8-4d2dd92d48c0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1192 microversion: 2.1 time: 0.370198 Sep 01 05:47:38.183629 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 554/1133] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:37 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1192 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:39.210425 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:39.211998 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:39.224269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:39.224269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:39.224269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:39.224269 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:39.224966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:39.224966 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:39.373682 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:39.382901 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-4b56f76f-ae06-48cf-961f-4de50ce6e587 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1277 microversion: 2.1 time: 0.177766 Sep 01 05:47:39.383491 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 580/1134] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:39 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:40.053213 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [req-6f0c985f-247c-4b88-abed-83964ce3dfbc req-b44e9e91-46ad-42aa-ad1d-916de1738ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44aeaa72-683e-46fa-a7b5-3e3645acff30", "tag": "a87b47a1-2e4b-47b5-9f07-220401283e08"}]} {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:40.062978 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6f0c985f-247c-4b88-abed-83964ce3dfbc req-b44e9e91-46ad-42aa-ad1d-916de1738ddd service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:40.063458 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6f0c985f-247c-4b88-abed-83964ce3dfbc req-b44e9e91-46ad-42aa-ad1d-916de1738ddd service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:40.064553 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [req-6f0c985f-247c-4b88-abed-83964ce3dfbc req-b44e9e91-46ad-42aa-ad1d-916de1738ddd service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:40.076017 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.compute.server_external_events [req-6f0c985f-247c-4b88-abed-83964ce3dfbc req-b44e9e91-46ad-42aa-ad1d-916de1738ddd service nova] Creating event network-changed:a87b47a1-2e4b-47b5-9f07-220401283e08 for instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 on hv-cinder-83602 Sep 01 05:47:40.081481 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [req-6f0c985f-247c-4b88-abed-83964ce3dfbc req-b44e9e91-46ad-42aa-ad1d-916de1738ddd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031894 Sep 01 05:47:40.086271 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 555/1135] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:40.404544 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:40.405100 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:40.411312 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:40.411778 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:40.412221 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:40.412892 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:40.413375 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:40.413742 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:40.543094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:40.550784 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-26506e3e-6d83-44c4-bb0a-129d4ffc4411 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.150160 Sep 01 05:47:40.551478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 581/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:40 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:41.572090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:41.572842 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:41.579014 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:41.579486 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:41.579912 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:41.580594 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:41.581036 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:41.581447 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:41.712897 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:41.720582 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-144006b3-c2e7-4e97-82bf-35299a0e59fb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.153197 Sep 01 05:47:41.721149 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 556/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:41 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:42.742253 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:42.742859 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:42.749160 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:42.749623 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:42.750047 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:42.750744 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:42.751185 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:42.751602 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:42.887930 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:42.895797 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-471bbf7f-96a1-4d06-a832-86adeb41a9b5 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.158070 Sep 01 05:47:42.896357 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 582/1138] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:42 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:43.915502 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:43.916032 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:43.922437 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.922930 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.923362 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:43.924039 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:43.924488 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:43.924905 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:44.056177 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:44.063920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-f0ad1f63-740f-43ae-8b98-d82f1e41a9bb tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.152433 Sep 01 05:47:44.064527 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 557/1139] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:43 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:45.085669 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:45.086306 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:45.092714 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:45.093187 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:45.093615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:45.094291 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:45.094761 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:45.095176 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:45.123198 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=2 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:45.143112 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell0:SELECT=6 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:45.222102 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:45.229943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-6585b6bc-a1aa-4f96-bd29-08444356e533 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.148845 Sep 01 05:47:45.230526 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 583/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:45 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:46.251569 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:46.252169 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:46.254632 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell0:SELECT=2 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:46.268223 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:46.268764 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:46.269201 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:46.269897 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:46.270399 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:46.270851 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:46.398678 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:46.406178 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8993dcd5-25e6-49f4-b0be-03678f0538f4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.158488 Sep 01 05:47:46.406772 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 558/1141] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:46 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:47.427009 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:47.427532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:47.434043 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:47.434561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:47.435018 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:47.435688 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:47.436138 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:47.436561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:47.570381 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:47.578147 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-29155e80-0827-4678-bb64-c9ea922fa42d tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.155097 Sep 01 05:47:47.578745 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 584/1142] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:47 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:48.599540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:48.600139 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:48.606591 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:48.607063 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:48.607491 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:48.608289 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:48.608735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:48.609148 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:48.738459 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:48.746924 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-cf63ef84-dbc0-4304-9eca-13dfea7b1272 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.152050 Sep 01 05:47:48.750830 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 559/1143] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:48 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:49.767503 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:49.768094 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:49.774475 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:49.774949 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:49.775380 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:49.776060 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:49.776504 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:49.776918 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:49.903048 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:49.910653 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-757e4055-2e53-427f-b196-55a2e06691fc tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.147265 Sep 01 05:47:49.911215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 585/1144] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:49 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:50.931214 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:50.931779 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:50.939615 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:50.940093 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:50.940525 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:50.941210 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:50.941655 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:50.942601 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:51.076698 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:51.084879 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-51885657-28ce-4a80-8883-1a49927f39d0 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.157675 Sep 01 05:47:51.085438 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 560/1145] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:50 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:51.269465 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-fe8f6515-536b-4242-bb5e-0404f0ec229c req-e6128958-eddf-4631-8a53-aac0e8b0d85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44aeaa72-683e-46fa-a7b5-3e3645acff30", "name": "network-vif-plugged", "status": "completed", "tag": "a87b47a1-2e4b-47b5-9f07-220401283e08"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:51.279215 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-fe8f6515-536b-4242-bb5e-0404f0ec229c req-e6128958-eddf-4631-8a53-aac0e8b0d85e service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:51.279690 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-fe8f6515-536b-4242-bb5e-0404f0ec229c req-e6128958-eddf-4631-8a53-aac0e8b0d85e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:51.280116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-fe8f6515-536b-4242-bb5e-0404f0ec229c req-e6128958-eddf-4631-8a53-aac0e8b0d85e service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:51.290985 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-fe8f6515-536b-4242-bb5e-0404f0ec229c req-e6128958-eddf-4631-8a53-aac0e8b0d85e service nova] Creating event network-vif-plugged:a87b47a1-2e4b-47b5-9f07-220401283e08 for instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 on hv-cinder-83602 Sep 01 05:47:51.294438 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR oslo.messaging._drivers.impl_rabbit [req-fe8f6515-536b-4242-bb5e-0404f0ec229c req-e6128958-eddf-4631-8a53-aac0e8b0d85e service nova] [a4ffb2bc-e86e-40c6-b387-2f221c485837] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 05:47:52.105424 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:52.106117 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:52.112473 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:52.112947 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:52.113378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:52.114060 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:52.114536 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:52.114970 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:52.244455 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:52.252313 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-987be348-890d-4615-8559-83d2ff9f2a79 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.150930 Sep 01 05:47:52.252871 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 561/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:52 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:52.301447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO oslo.messaging._drivers.impl_rabbit [req-fe8f6515-536b-4242-bb5e-0404f0ec229c req-e6128958-eddf-4631-8a53-aac0e8b0d85e service nova] [a4ffb2bc-e86e-40c6-b387-2f221c485837] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54614. Sep 01 05:47:52.305015 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-fe8f6515-536b-4242-bb5e-0404f0ec229c req-e6128958-eddf-4631-8a53-aac0e8b0d85e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.102670 Sep 01 05:47:52.305710 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 586/1147] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:47:53.272371 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:53.272963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:53.279265 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:53.279679 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:53.280104 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:53.280777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:53.281225 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:53.281634 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:53.410800 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:53.419020 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-516fb506-fd31-485d-b885-f5a2d45cd64a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1265 microversion: 2.1 time: 0.150538 Sep 01 05:47:53.426703 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 562/1148] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:53 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:54.441041 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:54.441734 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:54.448532 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:54.448996 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:54.449420 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:54.450086 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:54.450556 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:54.450987 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:54.583384 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:54.591040 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-16a2c3bc-32c4-47a2-8052-c3c48864ada4 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1452 microversion: 2.1 time: 0.154672 Sep 01 05:47:54.591605 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 587/1149] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:54 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:54.611316 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:47:54.611945 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:47:54.619304 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:54.619784 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:54.620219 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:54.620903 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:54.621355 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:54.621777 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:54.753940 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:47:54.761523 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b556fc81-a03c-4ffe-9d2e-230bfb50c733 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1452 microversion: 2.1 time: 0.154163 Sep 01 05:47:54.762083 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 563/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:47:54 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:47:56.921616 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-cdfd86b8-575d-4070-af5e-877863d48889 req-167c7c92-819c-4c99-a86d-a24022b20ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44aeaa72-683e-46fa-a7b5-3e3645acff30", "tag": "a87b47a1-2e4b-47b5-9f07-220401283e08"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:47:56.931840 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cdfd86b8-575d-4070-af5e-877863d48889 req-167c7c92-819c-4c99-a86d-a24022b20ef8 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:47:56.932313 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cdfd86b8-575d-4070-af5e-877863d48889 req-167c7c92-819c-4c99-a86d-a24022b20ef8 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:47:56.932739 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cdfd86b8-575d-4070-af5e-877863d48889 req-167c7c92-819c-4c99-a86d-a24022b20ef8 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:47:56.944072 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-cdfd86b8-575d-4070-af5e-877863d48889 req-167c7c92-819c-4c99-a86d-a24022b20ef8 service nova] Creating event network-changed:a87b47a1-2e4b-47b5-9f07-220401283e08 for instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 on hv-cinder-83602 Sep 01 05:47:56.949113 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-cdfd86b8-575d-4070-af5e-877863d48889 req-167c7c92-819c-4c99-a86d-a24022b20ef8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031289 Sep 01 05:47:56.949782 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 588/1151] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:24.949868 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_api:SELECT=24 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:24.950861 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG dbcounter [-] [121030] Writing DB stats nova_cell1:SELECT=56 {{(pid=121030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:24.952472 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 05:49:24.952608 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Thu Sep 1 05:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 (ip 10.222.0.16) !!! Sep 01 05:49:24.952715 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:24.955564 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG dbcounter [-] [121031] Writing DB stats nova_cell1:SELECT=54 {{(pid=121031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:49:24.958464 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:24.959252 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:24.961447 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-ef340c80-9446-402a-8f50-d6a5078d7ff7 req-f02bbbce-0ca9-4372-a66d-2b5ed981e1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44aeaa72-683e-46fa-a7b5-3e3645acff30", "tag": "a87b47a1-2e4b-47b5-9f07-220401283e08"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:24.966926 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:24.968896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:24.968896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:24.968896 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:24.969194 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:24.969623 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:24.976477 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ef340c80-9446-402a-8f50-d6a5078d7ff7 req-f02bbbce-0ca9-4372-a66d-2b5ed981e1fc service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:24.977031 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ef340c80-9446-402a-8f50-d6a5078d7ff7 req-f02bbbce-0ca9-4372-a66d-2b5ed981e1fc service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:24.977539 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-ef340c80-9446-402a-8f50-d6a5078d7ff7 req-f02bbbce-0ca9-4372-a66d-2b5ed981e1fc service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:24.989378 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-ef340c80-9446-402a-8f50-d6a5078d7ff7 req-f02bbbce-0ca9-4372-a66d-2b5ed981e1fc service nova] Creating event network-changed:a87b47a1-2e4b-47b5-9f07-220401283e08 for instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 on hv-cinder-83602 Sep 01 05:49:24.995131 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-ef340c80-9446-402a-8f50-d6a5078d7ff7 req-f02bbbce-0ca9-4372-a66d-2b5ed981e1fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044875 Sep 01 05:49:24.997157 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 589/1152] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 05:49:24.998565 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:49:25.257758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-ebd17122-2720-4680-a1fe-455dafa54c94 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 204 len: 0 microversion: 2.1 time: 0.309685 Sep 01 05:49:25.258378 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 564/1153] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:49:24 2022] DELETE /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:49:25.268402 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:25.273516 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:25.281355 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:25.281922 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:25.282448 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:25.283338 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:25.283860 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:25.284369 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:25.422561 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:25.430199 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-5aec5b5d-07a7-4f1a-bbe6-6acc848275b7 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1576 microversion: 2.1 time: 0.166597 Sep 01 05:49:25.430802 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 590/1154] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:25 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:26.451977 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:26.452682 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:26.459342 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:26.459835 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:26.460269 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:26.460963 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:26.461417 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:26.461841 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:26.627090 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:26.635219 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-9c5fcb81-80f1-4013-b358-1201516b2195 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1576 microversion: 2.1 time: 0.187389 Sep 01 05:49:26.636269 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 565/1155] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:26 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:27.309478 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-c707d722-c758-44ed-b08c-23547a890a49 req-9c035622-202c-4aa7-b07c-5452c9e76b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44aeaa72-683e-46fa-a7b5-3e3645acff30", "name": "network-vif-deleted", "tag": "a87b47a1-2e4b-47b5-9f07-220401283e08"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:27.319850 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c707d722-c758-44ed-b08c-23547a890a49 req-9c035622-202c-4aa7-b07c-5452c9e76b26 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:27.320329 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c707d722-c758-44ed-b08c-23547a890a49 req-9c035622-202c-4aa7-b07c-5452c9e76b26 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:27.320762 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-c707d722-c758-44ed-b08c-23547a890a49 req-9c035622-202c-4aa7-b07c-5452c9e76b26 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:27.334600 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-c707d722-c758-44ed-b08c-23547a890a49 req-9c035622-202c-4aa7-b07c-5452c9e76b26 service nova] Creating event network-vif-deleted:a87b47a1-2e4b-47b5-9f07-220401283e08 for instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 on hv-cinder-83602 Sep 01 05:49:27.339696 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-c707d722-c758-44ed-b08c-23547a890a49 req-9c035622-202c-4aa7-b07c-5452c9e76b26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033982 Sep 01 05:49:27.340359 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 591/1156] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:27.658959 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:27.665733 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:27.667048 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:27.667534 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:27.667972 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:27.668697 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:27.669146 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:27.669566 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:27.738461 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:27.746099 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-a47f51be-0ab0-4a07-a38d-763462322ded tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 200 len: 1225 microversion: 2.1 time: 0.092921 Sep 01 05:49:27.746684 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 566/1157] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:27 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:28.768264 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:28.768985 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 44aeaa72-683e-46fa-a7b5-3e3645acff30] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:28.775084 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:28.775550 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:28.775975 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:28.776652 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:28.777095 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:28.777510 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:28.791093 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] HTTP exception thrown: Instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 could not be found. Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Request method failure captured: Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 HTTP/1.1 Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEZaPwxrxBHg_X7V49pdf2pZB1Oz5_wzaoCdL3agMcwlWA8D9UOq025-8yCW5bHworFg5iEOoUBtYH0MYCmbTCRPoWcCtyfP7zVQaCM75DJOi-Qio7Vxxa37AUlj_UVSHyfXVphUuzVWH8dQk-YbIzmDtT6UTycNROFzDJangdYKKGQ Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:49:28.792707 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 32df71a35841485ba9166d0cad36755d Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 could not be found. Sep 01 05:49:28.794514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '44aeaa72-683e-46fa-a7b5-3e3645acff30'} Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 could not be found. Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:49:28.795649 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 could not be found. Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 could not be found. Sep 01 05:49:28.798028 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:28.799674 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Returning 404 to user: Instance 44aeaa72-683e-46fa-a7b5-3e3645acff30 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:49:28.799674 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-fcda91df-0923-4a71-af8b-16824d714f72 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30" status: 404 len: 111 microversion: 2.1 time: 0.030428 Sep 01 05:49:28.799674 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 592/1158] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:28 2022] GET /compute/v2.1/servers/44aeaa72-683e-46fa-a7b5-3e3645acff30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:49:32.106138 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:32.106669 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:32.113892 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:32.121087 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:32.121087 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:32.121087 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:32.121087 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:32.122002 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:32.149407 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Going to try to terminate instance {{(pid=121030) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 05:49:32.189044 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-d1386e64-d4a4-4293-8a35-c53210104b94 req-77f29b73-d6cd-43fa-b4b4-1d3bf9ae5133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eefc5e0d-386e-47e7-9adf-adcb740458ae", "tag": "cb932aa3-d95e-4deb-aba5-c78d19f36bdb"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:32.198699 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d1386e64-d4a4-4293-8a35-c53210104b94 req-77f29b73-d6cd-43fa-b4b4-1d3bf9ae5133 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:32.199243 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d1386e64-d4a4-4293-8a35-c53210104b94 req-77f29b73-d6cd-43fa-b4b4-1d3bf9ae5133 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:32.199735 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-d1386e64-d4a4-4293-8a35-c53210104b94 req-77f29b73-d6cd-43fa-b4b4-1d3bf9ae5133 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:32.211078 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-d1386e64-d4a4-4293-8a35-c53210104b94 req-77f29b73-d6cd-43fa-b4b4-1d3bf9ae5133 service nova] Creating event network-changed:cb932aa3-d95e-4deb-aba5-c78d19f36bdb for instance eefc5e0d-386e-47e7-9adf-adcb740458ae on hv-cinder-83602 Sep 01 05:49:32.216242 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-d1386e64-d4a4-4293-8a35-c53210104b94 req-77f29b73-d6cd-43fa-b4b4-1d3bf9ae5133 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104718 Sep 01 05:49:32.216842 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 593/1159] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:32.421351 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-76237dbc-328c-4347-a25b-2eac39241a5f tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 204 len: 0 microversion: 2.1 time: 0.318965 Sep 01 05:49:32.423759 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 567/1160] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:49:32 2022] DELETE /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 05:49:32.431752 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:32.432714 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:32.439799 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:32.440344 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:32.441035 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:32.442373 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:32.442943 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:32.444052 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:32.583332 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.policy [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121031) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:32.591092 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-a1916979-4e8c-40cc-8799-bf550c58bb86 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1577 microversion: 2.1 time: 0.163779 Sep 01 05:49:32.591663 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 594/1161] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:32 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:33.613906 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:33.614631 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:33.620920 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:33.621388 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:33.621816 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:33.622540 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:33.622985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:33.623400 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:33.803501 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:33.811182 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-230e0854-1d75-45ac-81b4-e1509c3eeffd tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1577 microversion: 2.1 time: 0.201980 Sep 01 05:49:33.811735 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 568/1162] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:33 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:34.427110 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [req-cf2001ca-4f85-4d23-90be-bfdefe3e2cc9 req-59aeafef-a702-4c53-a339-b3f7585a5a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eefc5e0d-386e-47e7-9adf-adcb740458ae", "name": "network-vif-deleted", "tag": "cb932aa3-d95e-4deb-aba5-c78d19f36bdb"}]} {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 05:49:34.436727 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cf2001ca-4f85-4d23-90be-bfdefe3e2cc9 req-59aeafef-a702-4c53-a339-b3f7585a5a51 service nova] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:34.437184 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cf2001ca-4f85-4d23-90be-bfdefe3e2cc9 req-59aeafef-a702-4c53-a339-b3f7585a5a51 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:34.437615 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [req-cf2001ca-4f85-4d23-90be-bfdefe3e2cc9 req-59aeafef-a702-4c53-a339-b3f7585a5a51 service nova] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:34.448479 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.compute.server_external_events [req-cf2001ca-4f85-4d23-90be-bfdefe3e2cc9 req-59aeafef-a702-4c53-a339-b3f7585a5a51 service nova] Creating event network-vif-deleted:cb932aa3-d95e-4deb-aba5-c78d19f36bdb for instance eefc5e0d-386e-47e7-9adf-adcb740458ae on hv-cinder-83602 Sep 01 05:49:34.454051 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [req-cf2001ca-4f85-4d23-90be-bfdefe3e2cc9 req-59aeafef-a702-4c53-a339-b3f7585a5a51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030016 Sep 01 05:49:34.454831 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 595/1163] 10.222.0.16 () {64 vars in 1317 bytes} [Thu Sep 1 05:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 05:49:34.833621 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:34.834231 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:34.840845 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:34.841327 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:34.841758 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:34.842543 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:34.843046 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:34.843468 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:34.905826 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.policy [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32df71a35841485ba9166d0cad36755d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b65e133d42c4ffa9ee97e8a21bb4a7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121030) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 05:49:34.913541 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-fe1e5802-e8b6-49d8-adeb-7dd59decd2f2 tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 200 len: 1226 microversion: 2.1 time: 0.083923 Sep 01 05:49:34.914105 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 569/1164] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:34 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 05:49:35.934974 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:35.935578 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: eefc5e0d-386e-47e7-9adf-adcb740458ae] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:35.942195 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:35.942689 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:35.943114 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:35.943785 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:35.944223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:35.944633 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:35.957896 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] HTTP exception thrown: Instance eefc5e0d-386e-47e7-9adf-adcb740458ae could not be found. Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Request method failure captured: Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae HTTP/1.1 Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEZaPwxrxBHg_X7V49pdf2pZB1Oz5_wzaoCdL3agMcwlWA8D9UOq025-8yCW5bHworFg5iEOoUBtYH0MYCmbTCRPoWcCtyfP7zVQaCM75DJOi-Qio7Vxxa37AUlj_UVSHyfXVphUuzVWH8dQk-YbIzmDtT6UTycNROFzDJangdYKKGQ Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:49:35.959497 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 32df71a35841485ba9166d0cad36755d Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance eefc5e0d-386e-47e7-9adf-adcb740458ae could not be found. Sep 01 05:49:35.961236 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': 'eefc5e0d-386e-47e7-9adf-adcb740458ae'} Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eefc5e0d-386e-47e7-9adf-adcb740458ae could not be found. Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:49:35.962223 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eefc5e0d-386e-47e7-9adf-adcb740458ae could not be found. Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eefc5e0d-386e-47e7-9adf-adcb740458ae could not be found. Sep 01 05:49:35.963933 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:35.965514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Returning 404 to user: Instance eefc5e0d-386e-47e7-9adf-adcb740458ae could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:49:35.965514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-c11d4745-ae65-40b5-b521-684dac4db84e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae" status: 404 len: 111 microversion: 2.1 time: 0.030240 Sep 01 05:49:35.965514 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 596/1165] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:35 2022] GET /compute/v2.1/servers/eefc5e0d-386e-47e7-9adf-adcb740458ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:49:36.457125 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:36.457672 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.compute.api [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121030) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:36.464087 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:36.464559 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:36.464985 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:36.465657 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:36.466100 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:36.466538 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG oslo_concurrency.lockutils [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121030) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:36.479508 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.wsgi [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] HTTP exception thrown: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Request method failure captured: Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: request: DELETE /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 HTTP/1.1 Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept: application/json Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Accept-Encoding: identity Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Connection: close Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Length: 0 Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Content-Type: application/json Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Host: 10.222.0.16 Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: Openstack-System-Scope: None Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: User-Agent: python-urllib3/1.26.12 Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Auth-Token: gAAAAABjEEZaPwxrxBHg_X7V49pdf2pZB1Oz5_wzaoCdL3agMcwlWA8D9UOq025-8yCW5bHworFg5iEOoUBtYH0MYCmbTCRPoWcCtyfP7zVQaCM75DJOi-Qio7Vxxa37AUlj_UVSHyfXVphUuzVWH8dQk-YbIzmDtT6UTycNROFzDJangdYKKGQ Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Id: None Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Domain-Name: None Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Identity-Status: Confirmed Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Is-Admin-Project: True Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Id: default Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Domain-Name: Default Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Project-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Role: member,reader Sep 01 05:49:36.481129 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Roles: member,reader Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-Tenant-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Id: default Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Domain-Name: Default Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Id: 32df71a35841485ba9166d0cad36755d Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: X-User-Name: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: method: > Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: exception: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.482838 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: action_args: {'id': '3db56f65-42d4-4b11-8b8a-fec2c4d72f07'} Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:49:36.483901 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.485563 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.487222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Returning 404 to user: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. {{(pid=121030) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:49:36.487222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-b51ad28f-116a-4901-9111-0bc1cfd4a30c tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 404 len: 111 microversion: 2.1 time: 0.029895 Sep 01 05:49:36.487222 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 570/1166] 10.222.0.16 () {58 vars in 1239 bytes} [Thu Sep 1 05:49:36 2022] DELETE /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:49:36.490919 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '>' {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:36.491551 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.compute.api [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] [instance: 3db56f65-42d4-4b11-8b8a-fec2c4d72f07] Fetching instance by UUID {{(pid=121031) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 05:49:36.497664 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:36.498140 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:36.498599 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:36.499281 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Acquiring lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 05:49:36.499724 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 05:49:36.500141 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG oslo_concurrency.lockutils [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Lock "7e5ccc8b-02a9-4328-be92-9856163a41bd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 05:49:36.514586 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.wsgi [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] HTTP exception thrown: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Request method failure captured: Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: request: GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 HTTP/1.1 Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept: application/json Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Accept-Encoding: identity Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Connection: close Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Length: 0 Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Content-Type: application/json Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Host: 10.222.0.16 Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: Openstack-System-Scope: None Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: User-Agent: python-urllib3/1.26.12 Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Auth-Token: gAAAAABjEEZaPwxrxBHg_X7V49pdf2pZB1Oz5_wzaoCdL3agMcwlWA8D9UOq025-8yCW5bHworFg5iEOoUBtYH0MYCmbTCRPoWcCtyfP7zVQaCM75DJOi-Qio7Vxxa37AUlj_UVSHyfXVphUuzVWH8dQk-YbIzmDtT6UTycNROFzDJangdYKKGQ Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Id: None Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Domain-Name: None Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Identity-Status: Confirmed Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Is-Admin-Project: True Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Id: default Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Domain-Name: Default Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Project-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Role: member,reader Sep 01 05:49:36.516116 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Roles: member,reader Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.16:8080", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5b65e133d42c4ffa9ee97e8a21bb4a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}] Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Id: 5b65e133d42c4ffa9ee97e8a21bb4a7a Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-Tenant-Name: tempest-TestVolumeBootPattern-983132711 Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Id: default Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Domain-Name: Default Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Id: 32df71a35841485ba9166d0cad36755d Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: X-User-Name: tempest-TestVolumeBootPattern-983132711-project Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: method: > Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: exception: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.518189 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: action_args: {'id': '3db56f65-42d4-4b11-8b8a-fec2c4d72f07'} Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: {{(pid=121031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 05:49:36.519410 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. Sep 01 05:49:36.520984 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: ERROR nova.api.openstack.wsgi Sep 01 05:49:36.522618 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: DEBUG nova.api.openstack.wsgi [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Returning 404 to user: Instance 3db56f65-42d4-4b11-8b8a-fec2c4d72f07 could not be found. {{(pid=121031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 05:49:36.522618 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: INFO nova.api.openstack.requestlog [None req-d4a2e35f-7d5d-4fd4-80c3-2ad07738139e tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07" status: 404 len: 111 microversion: 2.1 time: 0.030946 Sep 01 05:49:36.522618 dv-cinder-836027-8-iscsi devstack@n-api.service[121031]: [pid: 121031|app: 0|req: 597/1167] 10.222.0.16 () {58 vars in 1236 bytes} [Thu Sep 1 05:49:36 2022] GET /compute/v2.1/servers/3db56f65-42d4-4b11-8b8a-fec2c4d72f07 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 05:49:38.027294 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: DEBUG nova.api.openstack.wsgi [None req-8a76d1fa-76c4-4050-81c0-53e10934122a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] Calling method '.version_select at 0x7f953b0df4c0>' {{(pid=121030) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 05:49:38.143813 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: INFO nova.api.openstack.requestlog [None req-8a76d1fa-76c4-4050-81c0-53e10934122a tempest-TestVolumeBootPattern-983132711 tempest-TestVolumeBootPattern-983132711-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1100268181" status: 202 len: 0 microversion: 2.1 time: 0.120454 Sep 01 05:49:38.144377 dv-cinder-836027-8-iscsi devstack@n-api.service[121030]: [pid: 121030|app: 0|req: 571/1168] 10.222.0.16 () {58 vars in 1263 bytes} [Thu Sep 1 05:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1100268181 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)